-- Logs begin at Mon 2022-09-05 13:39:09 UTC, end at Mon 2022-09-05 15:37:45 UTC. -- Sep 05 14:25:36.603831 dv-cinder-842905-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 14:25:36.612424 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 14:25:36 2022] *** Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: nodename: dv-cinder-842905-3-iscsi Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: machine: x86_64 Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: clock source: unix Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: pcre jit disabled Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: detected number of CPU cores: 4 Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: current working directory: / Sep 05 14:25:36.614402 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: detected binary path: /usr/bin/uwsgi-core Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: your processes number limit is 47680 Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: your memory page size is 4096 bytes Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: detected max file descriptor number: 2048 Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: lock engine: pthread robust mutexes Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: thunder lock: enabled Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 14:25:36.615143 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 14:25:36.654258 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: Python main interpreter initialized at 0x56221ab549c0 Sep 05 14:25:36.654258 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: python threads support enabled Sep 05 14:25:36.654258 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: your server socket listen backlog is limited to 100 connections Sep 05 14:25:36.654258 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: your mercy for graceful operations on workers is 90 seconds Sep 05 14:25:36.654595 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 14:25:36.654672 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: *** Operational MODE: preforking *** Sep 05 14:25:36.654937 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: *** uWSGI is running in multiple interpreter mode *** Sep 05 14:25:36.654937 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: spawned uWSGI master process (pid: 106139) Sep 05 14:25:36.655134 dv-cinder-842905-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 14:25:36.656234 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: spawned uWSGI worker 1 (pid: 106140, cores: 1) Sep 05 14:25:36.656234 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: spawned uWSGI worker 2 (pid: 106141, cores: 1) Sep 05 14:25:36.656234 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 14:25:37.310241 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 14:25:37.317383 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 14:25:38.381518 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:25:38.381518 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: from cryptography.utils import int_from_bytes Sep 05 14:25:38.382113 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:25:38.382113 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: from cryptography.utils import int_from_bytes Sep 05 14:25:38.386984 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:25:38.386984 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: from cryptography.utils import int_from_bytes Sep 05 14:25:38.387409 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:25:38.387409 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: from cryptography.utils import int_from_bytes Sep 05 14:25:40.830338 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 14:25:40.830926 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 14:25:40.831146 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 14:25:40.831505 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 14:25:40.831757 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 14:25:40.832138 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.832459 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.832777 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.833091 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.833415 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.833719 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.834032 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.834344 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.834483 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 14:25:40.834885 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.834988 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 14:25:40.835076 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.835234 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.835345 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 14:25:40.835552 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842905-3-iscsi {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.835671 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 14:25:40.835865 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.835961 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 14:25:40.836170 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.836287 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.836477 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.836617 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.836784 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.836941 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.837082 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.837264 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.837397 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.837595 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.837711 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.837908 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.838170 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.838330 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.839337 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.839487 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.839605 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.839731 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.839884 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840007 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840131 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840260 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840401 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842905-3-iscsi {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840522 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840651 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840785 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.840919 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841039 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841174 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841301 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841430 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841561 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841696 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841827 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.841963 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842084 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842905-3-iscsi {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842213 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842345 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842345 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842585 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842731 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.842885 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843011 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843140 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843271 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843390 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843519 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843639 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843830 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.843973 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.844147 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.844283 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.844450 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.844578 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.844770 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.844911 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.845090 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.845232 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.845397 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.845532 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.845707 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.845840 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842905-3-iscsi {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846003 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846138 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846356 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846493 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846625 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846756 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.846957 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.847148 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.847288 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.847461 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.847597 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.847771 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.847915 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.848071 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.848212 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.848384 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.848519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.848697 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.848841 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849011 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849149 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849273 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849406 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849555 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849694 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849825 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.849950 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.850086 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.850243 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.850373 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.850556 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.850685 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.850887 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851018 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851340 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851516 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851659 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851821 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.851949 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.852086 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.852211 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.852393 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.852533 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.852708 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.852845 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853017 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853154 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853333 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853462 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853599 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853737 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853863 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.853995 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.854128 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.854296 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.854423 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.854560 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.854725 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.854885 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855061 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855190 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855400 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855539 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855664 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855801 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.855959 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.856094 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.856265 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.856417 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.856615 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.856751 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.856883 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857013 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857188 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857318 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857505 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857640 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857828 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.857955 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858129 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858266 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858437 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858564 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858688 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858836 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.858976 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.859111 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.859268 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.859405 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.859568 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.859710 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.859871 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860007 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860171 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860366 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860502 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860637 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860770 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.860895 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861025 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861196 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861343 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861507 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861644 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861815 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.861943 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.862643 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.862776 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.862997 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863134 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863301 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863439 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863565 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863705 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863844 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.863969 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.864144 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.864285 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.864463 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.864605 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.864767 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.864901 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865066 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865370 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865506 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865667 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865803 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.865972 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.866100 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.866270 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.866410 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.866571 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.866782 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.866941 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867075 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867202 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867336 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867462 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867573 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867771 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.867911 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868072 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868209 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868372 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868501 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868675 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868801 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.868965 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.869101 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.869265 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.869400 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.869572 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.869702 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.869873 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870012 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870169 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870307 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870448 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870583 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870747 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.870944 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871081 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871218 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871349 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871475 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871635 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871763 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.871931 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872060 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872224 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872353 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872533 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872662 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872847 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.872975 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.873150 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.873276 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.873451 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.873589 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.873750 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.873877 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.874062 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.874190 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.874388 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.874516 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.874694 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.874839 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.875039 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.875177 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.875345 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.875472 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.875648 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.875777 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.875975 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.876112 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.876279 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.876414 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.876581 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.876716 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.876928 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.877067 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.877201 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.877326 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.877472 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.877636 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.878359 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.878506 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.878678 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.878876 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.879034 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.879177 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.879342 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.879472 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.879665 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.879802 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:25:40.879977 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.880105 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.880288 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.880424 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.880601 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.880729 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.880907 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.881034 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.881220 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.881351 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.881541 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.881757 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.881895 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882028 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882167 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882299 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882468 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882598 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882819 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.882964 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.883133 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.883263 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.883451 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.883581 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.883763 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.883899 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.884069 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.884195 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.884375 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.884497 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.884682 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.884827 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885008 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885147 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885316 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885443 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885629 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885770 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.885941 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.886068 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.886247 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.886385 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.886563 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.886710 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.886973 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887125 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887254 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887378 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887511 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887645 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887799 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.887928 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.888105 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.888234 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.888432 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.888561 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.888740 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.888867 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.889057 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.889192 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.889365 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.889501 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.889671 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.889799 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890022 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890157 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890290 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890417 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890578 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890707 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.890907 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891038 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891205 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891344 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891501 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891639 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891799 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.891938 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.892100 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.892229 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.892397 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.892526 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.892710 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.892851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893028 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893164 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893328 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893494 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893675 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893813 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.893975 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.894105 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.894279 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.894408 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.894585 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.894729 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.894912 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895042 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895212 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895340 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895523 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895654 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895827 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.895955 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.896126 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.896255 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.896440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.896570 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.896742 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.896870 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897083 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897219 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897355 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897492 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897626 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897752 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.897924 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.898053 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.898232 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.898369 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.898536 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.898657 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.898865 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899016 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899175 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899304 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899481 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899610 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899797 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.899940 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.900100 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.900235 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.900403 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.900529 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.900713 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.900854 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901023 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901152 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901330 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901457 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901643 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901778 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.901962 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.902089 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.902273 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.902410 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.902572 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.902702 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.902902 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903043 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903205 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903337 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903505 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903635 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903805 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.903935 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.904110 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.904240 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.904408 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.904538 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.904708 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.904835 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905005 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905133 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905331 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905460 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905583 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905716 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.905894 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906033 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906198 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906328 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906497 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906625 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906809 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.906955 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.907186 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.907335 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.907462 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.907594 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.907741 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.907879 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.908077 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.908215 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.908389 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.908516 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.908696 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.908837 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.909541 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.909673 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.909856 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.909991 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.910167 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.910304 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.910469 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.910595 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.910773 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.910932 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.911107 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.911244 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.911415 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.911544 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.911724 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.911859 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912030 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912165 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912334 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912470 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912637 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912764 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.912957 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.913094 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.913264 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.913394 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.913579 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.913718 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.913878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.914006 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.914193 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.914322 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.914526 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.914663 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.914861 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915004 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915178 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915305 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915493 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915635 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915800 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.915937 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.916113 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.916240 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.916417 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.916554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.916727 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.916856 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917033 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917163 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917370 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917513 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917640 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917764 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.917929 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.918056 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.918243 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.918371 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.918549 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.918677 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.918886 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919026 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919193 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919320 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919508 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919635 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919808 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.919935 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.920117 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.920247 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.920439 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.920566 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.920769 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.920904 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921075 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921211 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921382 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921509 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921694 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921834 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.921997 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.922123 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.922301 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.922421 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.922606 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.922742 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.922956 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923081 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923204 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923508 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923649 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923817 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.923945 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.924122 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.924249 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.924424 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.924565 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.925260 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.925396 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.925575 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.925702 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.925888 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926030 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926190 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926317 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926490 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926617 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926810 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.926954 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.927142 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.927270 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.927475 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.927621 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.927757 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.927883 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928065 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928202 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928367 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928502 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928667 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928798 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.928977 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.929113 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.929280 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.929416 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.929582 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.929719 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.929882 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930010 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930180 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930317 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930494 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930634 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930817 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.930961 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.931124 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.931324 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.931451 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.931575 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.931727 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.931856 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932030 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932171 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932338 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932467 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932643 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932779 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.932947 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933089 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933260 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933390 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933564 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933691 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933866 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.933993 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.934171 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.934308 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.934476 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.934613 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.934833 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.934963 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.935087 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.935209 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.935407 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.935537 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.935709 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.935832 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936013 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936139 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936314 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936450 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936613 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936743 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.936918 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.937048 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.937230 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.937376 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.937547 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.937795 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.937902 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.938126 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.938224 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.938439 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.938537 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.938754 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.938864 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.939091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.939188 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.939404 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.939506 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.939718 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.939817 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940029 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940115 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940385 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940494 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940687 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940783 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.940995 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941090 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941295 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941390 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941595 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941682 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941900 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.941985 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.942202 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.942500 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.942767 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.942874 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.943116 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.943260 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.943415 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.943501 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.943714 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.943801 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944012 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944107 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944310 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944415 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944617 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944704 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.944916 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945002 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945222 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945317 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945523 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945620 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.945942 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.946147 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.946244 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.946444 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.946539 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.946744 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.946861 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.947070 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.947165 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.947385 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.947469 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.947694 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.947788 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948007 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948093 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948314 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948399 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948617 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948711 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.948922 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949009 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949228 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949330 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949533 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949632 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949829 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.949913 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.950127 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.950214 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.950423 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.950517 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.950726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.950842 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951059 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951146 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951358 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951452 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951662 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951753 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.951964 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.952048 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.952269 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.952355 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.952572 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.952657 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.952869 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.953220 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.953438 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.953526 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.953737 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.953830 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954047 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954133 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954350 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954436 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954645 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954731 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.954966 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.955071 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.955273 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.955369 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.955582 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.955743 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.955907 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956049 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956217 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956347 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956517 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956646 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956827 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.956967 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.957123 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.957258 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.957420 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.957549 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.957731 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.957935 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958073 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958206 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958332 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958457 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958657 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958838 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.958983 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959111 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959239 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959362 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959500 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959634 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959790 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.959928 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960096 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960225 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960397 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960527 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960694 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960823 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.960998 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.961133 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.961298 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.961426 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.961610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.961738 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.961909 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962052 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962337 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962505 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962632 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962818 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.962964 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.963122 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.963251 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.963424 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.963561 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.963721 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.963859 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964019 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964148 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964315 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964443 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964614 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964753 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.964911 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965048 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965213 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965339 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965515 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965644 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965818 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.965947 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.966116 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.966245 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.966413 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.966543 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.966732 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.966874 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967078 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967238 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967377 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967504 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967667 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967796 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.967973 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968078 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968284 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968387 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968588 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968682 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968891 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.968998 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.969191 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.969285 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.969490 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.969583 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.969790 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.969892 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.970092 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.970185 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.970399 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.970493 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.970699 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.970883 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.971022 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.971109 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.971323 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.971418 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.972214 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.972320 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.972487 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.972582 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.972804 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.972889 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.973121 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.973208 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.973465 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.973557 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.973734 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.973826 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974038 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974125 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974344 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974429 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974645 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974740 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.974974 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.975061 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.975288 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.975372 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.975595 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.975680 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.975904 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976009 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976202 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976287 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976509 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976605 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976808 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.976904 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.977107 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.977192 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.977449 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.977549 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.977769 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.977855 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.978072 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.978153 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.978392 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.978487 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.978695 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.978821 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979021 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979107 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979328 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979424 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979629 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979724 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.979935 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980021 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980235 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980322 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980551 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980655 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980864 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.980949 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.981176 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.981262 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.981511 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.981598 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.981833 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.981917 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.982136 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.982221 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.982445 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.982536 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.982752 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.982868 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.983088 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.983176 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.983469 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.983595 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.983792 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.983876 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.984099 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.984185 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.984404 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.984489 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.984706 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.984800 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985005 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985092 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985310 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985396 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985627 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985757 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.985930 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.986095 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.986237 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.986399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.986548 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.986727 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.986917 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.987163 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.987803 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.988004 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.988169 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.988462 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.988607 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.988746 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.988893 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989044 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989193 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989389 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989562 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989707 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989845 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.989992 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.990140 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.990291 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.990429 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.990590 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.990736 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.990930 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.991085 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.991233 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.991379 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.991518 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.991694 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.991849 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.992033 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.992188 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.992382 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.992534 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.992703 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.992874 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993027 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993175 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993324 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993464 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993602 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993741 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.993901 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.994058 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.994199 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.994347 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.994508 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.994655 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.994936 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.995102 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.995245 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.995383 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.995547 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.995694 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.995865 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996024 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996187 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996344 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996484 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996622 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996770 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.996917 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997056 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997243 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997390 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997528 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997680 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997820 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.997966 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.998105 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.998260 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.998417 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.998702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.998893 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.998992 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999082 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999163 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999310 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999410 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999648 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999734 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:40.999953 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000042 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000269 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000356 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000583 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000678 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000888 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.000983 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.001203 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.001292 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.001516 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.001602 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.001814 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.001900 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.002129 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.002216 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.002434 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.002527 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.002756 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.002867 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.003088 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.003183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.003389 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.003474 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.003723 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.003826 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004021 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004108 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004331 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004423 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004643 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004739 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.004953 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005046 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005257 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005342 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005557 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005650 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005877 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.005964 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.006182 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.006280 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.006492 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.006590 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.006844 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.006942 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.007142 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.007240 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.007443 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.007538 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.007743 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.007830 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008048 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008135 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008350 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008437 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008651 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008736 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.008950 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009043 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009251 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009336 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009549 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009633 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009851 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.009945 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.010152 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.010238 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.010468 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.010562 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.010770 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.010881 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.011109 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.011195 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.011415 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.011501 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.011716 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.011811 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012019 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012144 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012320 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012406 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012655 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012750 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.012956 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013042 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013279 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013365 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013580 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013673 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013894 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.013983 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.014199 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.014286 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.014505 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.014592 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.014828 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.014918 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.015141 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.015229 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.015446 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.015532 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.015748 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.015834 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016052 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016138 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016365 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016462 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016665 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016749 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.016978 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.017085 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.017286 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.017371 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.017591 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.017799 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.017885 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.018127 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.018221 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.018475 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.018565 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.018797 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.018885 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.019118 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.019214 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.019430 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.019524 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.019741 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.019827 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020050 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020137 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020360 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020455 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020666 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020754 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.020974 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.021062 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.021295 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.021383 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.021612 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.021711 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.021926 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022011 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022238 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022324 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022553 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022648 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022884 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.022974 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.023198 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.023295 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.023510 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.023723 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.023858 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.024060 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.024170 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.024379 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.024473 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.024697 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.024783 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025014 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025108 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025332 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025433 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025647 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025731 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.025953 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.026038 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.026264 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.026373 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.026575 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.026681 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.026903 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027024 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027214 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027326 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027524 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027623 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027830 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.027916 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.028146 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.028241 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.028472 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.028559 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.028786 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.028877 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.029094 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.029179 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.029400 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.029486 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.029708 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.029803 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.030056 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.030218 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.030364 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.030536 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.030679 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.030889 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031023 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031210 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031363 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031528 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031625 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031839 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.031927 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.032150 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.032243 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.032468 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.032567 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.032768 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.032918 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033068 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033156 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033374 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033469 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033678 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033763 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.033978 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.034574 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.034847 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.034938 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.035157 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.035254 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.035457 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.035543 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.035773 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.035860 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.036078 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.036164 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.036604 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.036721 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.036948 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037044 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037258 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037351 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037575 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037668 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037895 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.037988 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.038205 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.038307 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.038506 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.038615 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.038842 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.038956 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.039146 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.039228 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.039445 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.039544 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.039756 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.039843 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040062 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040151 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040362 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040457 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040661 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040747 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.040968 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041060 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041274 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041367 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041572 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041657 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041877 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.041962 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.042176 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.042409 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.042500 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.042747 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.042877 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043086 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043185 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043383 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043469 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043689 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043774 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.043988 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044082 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044287 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044372 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044585 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044680 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044883 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.044981 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.045186 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.045272 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.045486 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.045572 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.045789 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.045876 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.046086 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.046179 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.046389 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.046473 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.046704 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.046836 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047041 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047135 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047350 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047443 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047664 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047765 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.047961 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048053 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048261 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048363 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048570 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048664 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048872 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.048971 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.049179 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.049286 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.049479 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.049565 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.049835 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.049923 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.050143 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.050239 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.050449 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.050536 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.050756 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051020 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051109 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051355 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051443 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051675 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051761 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.051979 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.052070 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.052292 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.052379 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.052615 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.052700 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.052922 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053016 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053226 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053311 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053547 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053633 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.053945 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.054159 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.054243 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.054465 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.054550 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.054771 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.054893 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.055099 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.055184 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.055404 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.055489 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.055708 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.055802 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056012 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056098 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056316 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056410 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056619 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056871 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.056970 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.057204 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.057290 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.057509 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.057619 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.057830 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.057927 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.058119 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.058206 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.058452 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.058551 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.058762 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.058880 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.059091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.059185 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.059400 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.059492 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.059713 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.059806 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060017 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060104 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060324 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060417 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060632 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060725 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.060948 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061030 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061245 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061330 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061549 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061634 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061857 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.061957 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.062153 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.062239 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.062458 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.062766 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.062870 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.063095 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.063184 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.063403 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.063498 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.063709 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.063795 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064022 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064109 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064340 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064427 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064659 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064754 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.064967 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.065054 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.065801 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.065891 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.066110 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.066207 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.066418 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.066509 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.066728 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.066836 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067064 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067162 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067375 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067463 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067689 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067792 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.067987 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.068083 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.068288 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.068374 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.068592 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.068678 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.068906 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.069209 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.069294 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.069507 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.069593 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.069804 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.069899 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.070105 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.070191 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.070403 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.070491 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.070701 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.070815 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071033 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071119 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071329 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071415 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071632 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071727 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.071927 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.072035 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.072223 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.072367 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.072518 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.072709 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.072815 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073041 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073117 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073368 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073454 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073675 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073752 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.073969 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074044 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074312 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074410 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074567 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074643 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074883 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.074963 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.075181 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.075258 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.075500 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.075575 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.075805 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.075881 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.076117 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.076194 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.076424 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.076500 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.076726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.076801 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.077029 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.077105 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.077334 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.077410 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.077644 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.077746 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.078202 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.078289 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.078505 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.078580 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.078819 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.078911 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.079127 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.079203 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.079431 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.079519 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.079734 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.079834 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080038 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080131 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080385 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080477 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080642 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080737 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.080990 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.081081 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.081294 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.081380 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.081595 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.081682 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.081925 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082019 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082242 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082556 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082641 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082892 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.082980 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.083204 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.083299 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.083511 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.083603 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.083824 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.083908 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.084128 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.084221 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.084434 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.084525 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.084741 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.084827 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085046 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085141 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085352 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085445 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085663 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085749 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.085975 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.086134 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.086279 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.086372 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.086587 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.086678 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.086918 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087021 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087231 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087324 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087555 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087647 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087862 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.087964 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.088174 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.088269 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.088488 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.088582 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.088805 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.088891 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.089125 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.089210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.089449 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.089536 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.089771 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.089887 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090082 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090173 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090392 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090499 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090694 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090874 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.090965 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106140) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 14:25:41.091036 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.091374 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.091639 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.091957 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.092269 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.092580 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.092897 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.093211 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.093541 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.093869 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.094165 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.094492 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.094841 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.095192 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.095507 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.095853 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.096183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.097010 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.097334 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.097641 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:25:41.097884 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 14:25:41.244301 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO dbcounter [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Registered counter for database nova_api Sep 05 14:25:41.249811 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Registered counter for database nova_api Sep 05 14:25:41.265435 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_db.sqlalchemy.engines [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.272437 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.272570 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writer thread running {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.278929 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.329525 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.context [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e0c2985-b818-4cf9-b8fa-977a4355658f(cell1) {{(pid=106140) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 14:25:41.333684 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:25:41.334114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:25:41.335723 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:25:41.336448 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:25:41.336553 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.context [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e0c2985-b818-4cf9-b8fa-977a4355658f(cell1) {{(pid=106141) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 14:25:41.336889 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:25:41.339216 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:25:41.340383 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:25:41.340871 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:25:41.341195 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO dbcounter [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Registered counter for database nova_cell0 Sep 05 14:25:41.342465 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:25:41.343238 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:25:41.343688 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:25:41.345275 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO dbcounter [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Registered counter for database nova_cell1 Sep 05 14:25:41.345683 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_concurrency.lockutils [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106141) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:25:41.347801 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Registered counter for database nova_cell0 Sep 05 14:25:41.351924 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Registered counter for database nova_cell1 Sep 05 14:25:41.352175 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_db.sqlalchemy.engines [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.353776 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_db.sqlalchemy.engines [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.359801 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.360110 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writer thread running {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.360968 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.361484 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writer thread running {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.369601 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.371517 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.505955 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO dbcounter [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Registered counter for database nova_cell0 Sep 05 14:25:41.514880 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_db.sqlalchemy.engines [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106140) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.519352 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writer thread running {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.521585 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO dbcounter [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Registered counter for database nova_cell0 Sep 05 14:25:41.530602 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG oslo_db.sqlalchemy.engines [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:25:41.535009 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writer thread running {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:25:41.918434 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: WARNING keystonemiddleware.auth_token [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:25:41.925793 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: WARNING keystonemiddleware.auth_token [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:25:41.956047 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:25:41.963314 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:25:42.266044 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: WARNING keystonemiddleware.auth_token [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:25:42.272134 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: WARNING keystonemiddleware.auth_token [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:25:42.277480 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56221ab549c0 pid: 106140 (default app) Sep 05 14:25:42.279616 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:25:42.280790 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] 10.222.0.15 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001745 Sep 05 14:25:42.281201 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 788 bytes} [Mon Sep 5 14:25:42 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:25:42.311808 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:25:42.318422 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: WARNING keystonemiddleware.auth_token [None req-7d5f8b4e-ba56-4ef3-a64f-a9de8fd45ac0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:25:42.323779 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56221ab549c0 pid: 106141 (default app) Sep 05 14:27:02.262159 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:02.263218 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 05 14:27:02.263802 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 2/2] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:02.276628 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:02.277719 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_cell1:SELECT=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:02.278932 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_cell0:SELECT=3 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:02.280986 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:03.133002 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-e7d690a2-e511-4f88-8554-5427e4702bbd admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:03.167269 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-e7d690a2-e511-4f88-8554-5427e4702bbd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.895679 Sep 05 14:27:03.174900 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 5 14:27:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 898 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:27:05.524348 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:05.525392 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-17ab12e3-6a90-416e-8451-b12d9c436fd9 None None] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 05 14:27:05.525784 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 3/4] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:05.979232 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-57f3011a-63e3-424e-9345-a15498d86389 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "swap": 0, "vcpus": 1, "id": "c1", "os-flavor-access:is_public": true, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 1}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:06.089427 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-57f3011a-63e3-424e-9345-a15498d86389 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.557274 Sep 05 14:27:06.097414 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 2/5] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:27:06.103859 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_api:SELECT=3 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:06.104720 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_cell1:SELECT=3 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:06.106988 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_cell0:SELECT=3 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:06.108158 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:06.323955 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-3aadbecd-bb79-48cb-90bb-ba30013f5a83 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:06.510060 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-3aadbecd-bb79-48cb-90bb-ba30013f5a83 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.411408 Sep 05 14:27:06.510660 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 4/6] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 5 14:27:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:08.878713 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-57f3011a-63e3-424e-9345-a15498d86389 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:08.879776 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-57f3011a-63e3-424e-9345-a15498d86389 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001520 Sep 05 14:27:08.880448 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 3/7] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:27:09.553956 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-c2b3ad19-67da-42ab-b8b0-7a88a7e9a72c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1"}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:09.676075 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-c2b3ad19-67da-42ab-b8b0-7a88a7e9a72c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.789147 Sep 05 14:27:09.676742 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 5/8] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:27:09.689589 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-2e6fbba6-9f6b-48b6-9828-4fd6154c4c6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:09.820197 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-2e6fbba6-9f6b-48b6-9828-4fd6154c4c6b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.135192 Sep 05 14:27:09.821307 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 4/9] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 5 14:27:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:12.152285 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-c2b3ad19-67da-42ab-b8b0-7a88a7e9a72c admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:12.153305 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-c2b3ad19-67da-42ab-b8b0-7a88a7e9a72c admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001462 Sep 05 14:27:12.153712 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 6/10] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:12.554572 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a2d36df6-f459-4e3f-aff8-437f8e493fef admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d2", "disk": 10, "vcpus": 1, "name": "ds1G"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:12.635169 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-a2d36df6-f459-4e3f-aff8-437f8e493fef admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.474942 Sep 05 14:27:12.635747 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 5/11] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:27:12.648460 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-4e53b18e-b32b-4400-9ce3-367a4d698427 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:12.739525 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-4e53b18e-b32b-4400-9ce3-367a4d698427 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.094717 Sep 05 14:27:12.740151 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 7/12] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 5 14:27:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:15.062351 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a2d36df6-f459-4e3f-aff8-437f8e493fef admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:15.063433 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-a2d36df6-f459-4e3f-aff8-437f8e493fef admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Sep 05 14:27:15.063882 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 6/13] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:15.493134 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-3449c43a-f7bc-4302-a2f9-456658f57233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "ram": 2048, "id": "d3", "disk": 10, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:15.589632 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-3449c43a-f7bc-4302-a2f9-456658f57233 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519027 Sep 05 14:27:15.590300 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 8/14] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:27:15.603040 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-d3f587f5-eb7d-4a3c-95ab-0af9b6ea054c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:15.701738 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-d3f587f5-eb7d-4a3c-95ab-0af9b6ea054c admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102467 Sep 05 14:27:15.702672 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 7/15] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 5 14:27:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:18.054565 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-3449c43a-f7bc-4302-a2f9-456658f57233 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:18.055606 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-3449c43a-f7bc-4302-a2f9-456658f57233 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Sep 05 14:27:18.056003 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 9/16] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:18.487879 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-c3f61770-6b5e-4555-b870-c746aae79d9b admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds4G", "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "swap": 0, "rxtx_factor": 1.0, "disk": 20}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:18.620795 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-c3f61770-6b5e-4555-b870-c746aae79d9b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.558527 Sep 05 14:27:18.622747 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 8/17] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:27:18.634059 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-429560ea-e668-48e4-9e00-d2776e8d64ec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:18.796604 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-429560ea-e668-48e4-9e00-d2776e8d64ec admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.157423 Sep 05 14:27:18.796604 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 10/18] 10.222.0.15 () {64 vars in 1336 bytes} [Mon Sep 5 14:27:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:21.378523 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-c3f61770-6b5e-4555-b870-c746aae79d9b admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:21.379584 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-c3f61770-6b5e-4555-b870-c746aae79d9b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001513 Sep 05 14:27:21.379993 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 9/19] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:21.790663 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-ae4ffc9f-8ec5-4b20-a20a-a241d6af6eed admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:21.816206 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-ae4ffc9f-8ec5-4b20-a20a-a241d6af6eed admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.430106 Sep 05 14:27:21.816773 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 11/20] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 5 14:27:21 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:27:24.843618 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-c3f61770-6b5e-4555-b870-c746aae79d9b admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:24.844553 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-c3f61770-6b5e-4555-b870-c746aae79d9b admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Sep 05 14:27:24.845028 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 10/21] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:25.285443 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-aa67eff1-2fa3-4f1d-b459-2a1f6c92ceeb admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1, "ram": 512, "disk": 1, "name": "m1.tiny", "swap": 0}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:25.365636 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-aa67eff1-2fa3-4f1d-b459-2a1f6c92ceeb admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.513167 Sep 05 14:27:25.366233 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 12/22] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:24 2022] POST /compute/v2.1/flavors => generated 402 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:27:25.378812 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-51278331-d1e9-4f20-89d4-2535cbd9abb3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:25.495233 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-51278331-d1e9-4f20-89d4-2535cbd9abb3 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.120625 Sep 05 14:27:25.495812 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 11/23] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 5 14:27:25 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:27.823710 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-aa67eff1-2fa3-4f1d-b459-2a1f6c92ceeb admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:27.824753 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-aa67eff1-2fa3-4f1d-b459-2a1f6c92ceeb admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001682 Sep 05 14:27:27.825303 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:28.216251 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-6c7763e6-bf50-48f1-aede-c32fc3bff329 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "2", "disk": 20, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.small"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:28.332868 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-6c7763e6-bf50-48f1-aede-c32fc3bff329 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.500655 Sep 05 14:27:28.333360 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 12/25] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:27 2022] POST /compute/v2.1/flavors => generated 405 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:27:28.346814 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-e06c4f73-4d64-4888-a445-eec876a8620d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:28.529124 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-e06c4f73-4d64-4888-a445-eec876a8620d admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.186963 Sep 05 14:27:28.529689 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 14/26] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 5 14:27:28 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:27:30.933761 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-6c7763e6-bf50-48f1-aede-c32fc3bff329 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:30.935435 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-6c7763e6-bf50-48f1-aede-c32fc3bff329 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002187 Sep 05 14:27:30.935844 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 13/27] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:31.380887 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-0d80ba9e-ca37-4d2d-be53-4d42b5016eb1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "id": "3", "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium", "vcpus": 2, "disk": 40}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:31.484325 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-0d80ba9e-ca37-4d2d-be53-4d42b5016eb1 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.542500 Sep 05 14:27:31.485221 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 15/28] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:30 2022] POST /compute/v2.1/flavors => generated 406 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:27:31.497118 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-d4633d19-150d-4df5-a692-a9eb44b38a56 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:31.597674 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-d4633d19-150d-4df5-a692-a9eb44b38a56 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.101073 Sep 05 14:27:31.597674 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 14/29] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 5 14:27:31 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:33.976194 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-0d80ba9e-ca37-4d2d-be53-4d42b5016eb1 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:33.977205 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-0d80ba9e-ca37-4d2d-be53-4d42b5016eb1 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Sep 05 14:27:33.977841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 16/30] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:34.418090 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-bd588584-901e-42b0-9972-79f849891465 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "name": "m1.large", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "4"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:34.424485 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:34.486254 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-bd588584-901e-42b0-9972-79f849891465 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.502051 Sep 05 14:27:34.494779 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 15/31] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:27:34.502592 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-5da0c26c-acc3-48bb-aceb-450d05d04d76 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:34.628917 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-5da0c26c-acc3-48bb-aceb-450d05d04d76 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.130452 Sep 05 14:27:34.643178 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 17/32] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 5 14:27:34 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:27:37.118002 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-bd588584-901e-42b0-9972-79f849891465 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:37.119605 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-bd588584-901e-42b0-9972-79f849891465 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002040 Sep 05 14:27:37.120176 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 16/33] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:37.557362 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-e3b37ec2-349d-4706-9b69-c9d3ff9c0ea2 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 8, "id": "5", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "ram": 16384, "name": "m1.xlarge", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:37.674388 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-e3b37ec2-349d-4706-9b69-c9d3ff9c0ea2 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.547976 Sep 05 14:27:37.674972 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 18/34] 10.222.0.15 () {64 vars in 1283 bytes} [Mon Sep 5 14:27:37 2022] POST /compute/v2.1/flavors => generated 408 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:27:37.687961 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-27b86ad4-0f11-4f5b-92f8-e4d95baaad6e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:27:37.763569 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-27b86ad4-0f11-4f5b-92f8-e4d95baaad6e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080047 Sep 05 14:27:37.771168 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 17/35] 10.222.0.15 () {64 vars in 1333 bytes} [Mon Sep 5 14:27:37 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:27:56.564499 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-e3b37ec2-349d-4706-9b69-c9d3ff9c0ea2 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:56.565518 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-e3b37ec2-349d-4706-9b69-c9d3ff9c0ea2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 05 14:27:56.565921 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 19/36] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:27:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:56.950050 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-2fed6bd1-e29d-4103-b68b-f504259538cb admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:56.967917 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-2fed6bd1-e29d-4103-b68b-f504259538cb admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.395970 Sep 05 14:27:56.968439 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 18/37] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 5 14:27:56 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:27:58.009323 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-e3b37ec2-349d-4706-9b69-c9d3ff9c0ea2 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:58.010313 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-e3b37ec2-349d-4706-9b69-c9d3ff9c0ea2 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Sep 05 14:27:58.010694 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 20/38] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:27:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:27:58.524391 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-8eebff32-724b-4f39-b600-adfc365d5cdd admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:58.529817 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.wsgi [None req-8eebff32-724b-4f39-b600-adfc365d5cdd admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-8eebff32-724b-4f39-b600-adfc365d5cdd admin admin] Request method failure captured: Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Accept: application/json Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Accept-Encoding: gzip, deflate Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Connection: keep-alive Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Content-Length: 0 Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Host: 10.222.0.15 Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Openstack-Api-Version: compute 2.92 Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Openstack-System-Scope: None Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: User-Agent: python-novaclient Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Auth-Token: gAAAAABjFgdt_YlnEsvSpTc7gneegPuJPE56PwM4kVBB8vdH2fwCyZKSH-lSfczMFEOazMzhEDxFcUwr7sX8bvKP_565tHlH3nZHlXU61wUHEru-VQdc9FBacXqQqDGBTpWv-jZnMaYneflUhIYVAu4JIWKTc7bCq0KAg3mkq9j9bFMgka6mg4E Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Domain-Id: None Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Domain-Name: None Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Identity-Status: Confirmed Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Is-Admin-Project: True Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Domain-Id: default Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Domain-Name: Default Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Name: admin Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Role: member,admin,reader Sep 05 14:27:58.533554 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Roles: member,admin,reader Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f189779a37444439ac0c4ef7b42cc427"}]}] Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant: admin Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant-Name: admin Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User: admin Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Domain-Id: default Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Domain-Name: Default Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Id: 40eedd635c074248bf2c6c67ebf16bb0 Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Name: admin Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: method: > Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: exception: Flavor 42 could not be found. Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: action_args: {'id': '42'} Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:27:58.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:27:58.536327 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.537851 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-8eebff32-724b-4f39-b600-adfc365d5cdd admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:27:58.539257 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-8eebff32-724b-4f39-b600-adfc365d5cdd admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387352 Sep 05 14:27:58.539257 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 19/39] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 5 14:27:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 388 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 05 14:27:58.544690 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-223f51da-c8fe-4a57-a22a-c6561c85f8a0 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:58.549980 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:27:58.568224 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-223f51da-c8fe-4a57-a22a-c6561c85f8a0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027075 Sep 05 14:27:58.568763 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 21/40] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 5 14:27:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:27:58.578374 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-2e8f1343-c7d4-4867-80bd-ef1c828ceb52 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:58.601519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-2e8f1343-c7d4-4867-80bd-ef1c828ceb52 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026686 Sep 05 14:27:58.602035 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 20/41] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 5 14:27:58 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:27:58.611273 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-df5f0336-267d-4b74-98ba-ad5713da224d admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:58.617159 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.wsgi [None req-df5f0336-267d-4b74-98ba-ad5713da224d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-df5f0336-267d-4b74-98ba-ad5713da224d admin admin] Request method failure captured: Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Accept: application/json Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Accept-Encoding: gzip, deflate Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Connection: keep-alive Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Content-Length: 0 Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Host: 10.222.0.15 Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Openstack-Api-Version: compute 2.92 Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Openstack-System-Scope: None Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: User-Agent: python-novaclient Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Auth-Token: gAAAAABjFgdt_YlnEsvSpTc7gneegPuJPE56PwM4kVBB8vdH2fwCyZKSH-lSfczMFEOazMzhEDxFcUwr7sX8bvKP_565tHlH3nZHlXU61wUHEru-VQdc9FBacXqQqDGBTpWv-jZnMaYneflUhIYVAu4JIWKTc7bCq0KAg3mkq9j9bFMgka6mg4E Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Domain-Id: None Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Domain-Name: None Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Identity-Status: Confirmed Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Is-Admin-Project: True Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Domain-Id: default Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Domain-Name: Default Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Name: admin Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Role: member,admin,reader Sep 05 14:27:58.620357 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Roles: member,admin,reader Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f189779a37444439ac0c4ef7b42cc427"}]}] Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant: admin Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant-Name: admin Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User: admin Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Domain-Id: default Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Domain-Name: Default Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Id: 40eedd635c074248bf2c6c67ebf16bb0 Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Name: admin Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: method: > Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: exception: Flavor 42 could not be found. Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: action_args: {'id': '42'} Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:27:58.621878 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:27:58.622841 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:27:58.630114 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-df5f0336-267d-4b74-98ba-ad5713da224d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:27:58.631437 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-df5f0336-267d-4b74-98ba-ad5713da224d admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013971 Sep 05 14:27:58.631437 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 22/42] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 5 14:27:58 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 05 14:27:59.576574 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-2e8f1343-c7d4-4867-80bd-ef1c828ceb52 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:27:59.577575 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-2e8f1343-c7d4-4867-80bd-ef1c828ceb52 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 Sep 05 14:27:59.577965 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 21/43] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:27:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:00.095164 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-5b38d365-b6e9-40ef-96a4-fb4c9ddbed6c admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:00.100455 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.wsgi [None req-5b38d365-b6e9-40ef-96a4-fb4c9ddbed6c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-5b38d365-b6e9-40ef-96a4-fb4c9ddbed6c admin admin] Request method failure captured: Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Accept: application/json Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Accept-Encoding: gzip, deflate Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Connection: keep-alive Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Content-Length: 0 Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Host: 10.222.0.15 Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Openstack-Api-Version: compute 2.92 Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Openstack-System-Scope: None Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: User-Agent: python-novaclient Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Auth-Token: gAAAAABjFgdvashJJP63lwfCmyA7dsMi9futIgG79RN3uQVVCsJ9B3Cz7A8QhnayJQxaaz0xPn-zfwqn8XWm1nhnuQgu8CmdCUx77On7r4t8eceo0hreRQaCsuUUhYqbUK6r8cna6WgoSXnjnnO1tKia_JRANwOFrmk_kSsAPjARrrTuPToPhHw Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Domain-Id: None Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Domain-Name: None Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Identity-Status: Confirmed Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Is-Admin-Project: True Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Domain-Id: default Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Domain-Name: Default Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Name: admin Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Role: member,admin,reader Sep 05 14:28:00.101937 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Roles: member,admin,reader Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f189779a37444439ac0c4ef7b42cc427"}]}] Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant: admin Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant-Name: admin Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User: admin Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Domain-Id: default Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Domain-Name: Default Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Id: 40eedd635c074248bf2c6c67ebf16bb0 Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Name: admin Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: method: > Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: exception: Flavor 84 could not be found. Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: action_args: {'id': '84'} Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:28:00.103514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:00.104610 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.106023 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-5b38d365-b6e9-40ef-96a4-fb4c9ddbed6c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:28:00.107313 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-5b38d365-b6e9-40ef-96a4-fb4c9ddbed6c admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.388385 Sep 05 14:28:00.107313 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 23/44] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 5 14:27:59 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:00.113107 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-a404346f-c7c9-4c30-a3a9-80cc7e998064 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:00.127889 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-a404346f-c7c9-4c30-a3a9-80cc7e998064 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018500 Sep 05 14:28:00.128412 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 22/45] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 5 14:28:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:28:00.137727 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-3f70aee6-120f-4c7d-abda-d6e58662dcc9 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:00.152857 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-3f70aee6-120f-4c7d-abda-d6e58662dcc9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018658 Sep 05 14:28:00.153370 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 24/46] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 5 14:28:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:28:00.162953 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-187c90d2-fc51-44db-ab6c-a57fc85c96a6 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:00.168123 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.wsgi [None req-187c90d2-fc51-44db-ab6c-a57fc85c96a6 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-187c90d2-fc51-44db-ab6c-a57fc85c96a6 admin admin] Request method failure captured: Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Accept: application/json Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Accept-Encoding: gzip, deflate Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Connection: keep-alive Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Content-Length: 0 Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Host: 10.222.0.15 Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Openstack-Api-Version: compute 2.92 Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Openstack-System-Scope: None Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: User-Agent: python-novaclient Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Auth-Token: gAAAAABjFgdvashJJP63lwfCmyA7dsMi9futIgG79RN3uQVVCsJ9B3Cz7A8QhnayJQxaaz0xPn-zfwqn8XWm1nhnuQgu8CmdCUx77On7r4t8eceo0hreRQaCsuUUhYqbUK6r8cna6WgoSXnjnnO1tKia_JRANwOFrmk_kSsAPjARrrTuPToPhHw Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Domain-Id: None Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Domain-Name: None Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Identity-Status: Confirmed Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Is-Admin-Project: True Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Domain-Id: default Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Domain-Name: Default Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Name: admin Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Role: member,admin,reader Sep 05 14:28:00.169614 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Roles: member,admin,reader Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f189779a37444439ac0c4ef7b42cc427"}]}] Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant: admin Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant-Name: admin Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User: admin Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Domain-Id: default Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Domain-Name: Default Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Id: 40eedd635c074248bf2c6c67ebf16bb0 Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Name: admin Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: method: > Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: exception: Flavor 84 could not be found. Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: action_args: {'id': '84'} Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:28:00.171183 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:00.172139 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:00.173519 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-187c90d2-fc51-44db-ab6c-a57fc85c96a6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:28:00.174750 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-187c90d2-fc51-44db-ab6c-a57fc85c96a6 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011505 Sep 05 14:28:00.174750 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 23/47] 10.222.0.15 () {60 vars in 1190 bytes} [Mon Sep 5 14:28:00 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:01.143054 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-3f70aee6-120f-4c7d-abda-d6e58662dcc9 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:01.144061 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-3f70aee6-120f-4c7d-abda-d6e58662dcc9 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 Sep 05 14:28:01.144457 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 25/48] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:28:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:01.665725 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-d8c03089-9da1-49af-9d7c-1bc96bdfb630 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:01.671395 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.wsgi [None req-d8c03089-9da1-49af-9d7c-1bc96bdfb630 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-d8c03089-9da1-49af-9d7c-1bc96bdfb630 admin admin] Request method failure captured: Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Accept: application/json Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Accept-Encoding: gzip, deflate Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Connection: keep-alive Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Content-Length: 0 Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Host: 10.222.0.15 Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Openstack-Api-Version: compute 2.92 Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Openstack-System-Scope: None Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: User-Agent: python-novaclient Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Auth-Token: gAAAAABjFgdxX8JtyN_fwppC5Sfq4leazeZ1XotFqVEPKizoa2jV72xEeY0xjgL2k8TCmPy353ceElMXT0XVGECkiKKIS5un1RGswW8FovjUl36IbyFLhEbP5zvoWfbGU6BJpvcm6u-aOniu0kZS-xgfmygZ-CopjpXqSxjSQ73XSrGr99oWAso Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Domain-Id: None Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Domain-Name: None Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Identity-Status: Confirmed Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Is-Admin-Project: True Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Domain-Id: default Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Domain-Name: Default Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Project-Name: admin Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Role: member,admin,reader Sep 05 14:28:01.673399 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Roles: member,admin,reader Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f189779a37444439ac0c4ef7b42cc427"}]}] Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant: admin Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-Tenant-Name: admin Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User: admin Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Domain-Id: default Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Domain-Name: Default Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Id: 40eedd635c074248bf2c6c67ebf16bb0 Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: X-User-Name: admin Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: method: > Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: exception: Flavor 451 could not be found. Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: action_args: {'id': '451'} Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:28:01.675170 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:01.676091 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.677210 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-d8c03089-9da1-49af-9d7c-1bc96bdfb630 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106141) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:28:01.678295 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-d8c03089-9da1-49af-9d7c-1bc96bdfb630 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394466 Sep 05 14:28:01.678295 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 24/49] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 5 14:28:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:01.684327 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-62d23d87-422e-48dd-abe7-85d441898b18 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:01.699918 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-62d23d87-422e-48dd-abe7-85d441898b18 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019052 Sep 05 14:28:01.700443 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 26/50] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 5 14:28:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:28:01.710176 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:01.724916 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018325 Sep 05 14:28:01.725439 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 25/51] 10.222.0.15 () {60 vars in 1210 bytes} [Mon Sep 5 14:28:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:28:01.734388 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-cb929f7c-1c79-4b20-b5ac-46fe6b09a7d0 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:01.740234 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.wsgi [None req-cb929f7c-1c79-4b20-b5ac-46fe6b09a7d0 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-cb929f7c-1c79-4b20-b5ac-46fe6b09a7d0 admin admin] Request method failure captured: Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Accept: application/json Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Accept-Encoding: gzip, deflate Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Connection: keep-alive Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Content-Length: 0 Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Host: 10.222.0.15 Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Openstack-Api-Version: compute 2.92 Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Openstack-System-Scope: None Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: User-Agent: python-novaclient Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Auth-Token: gAAAAABjFgdxX8JtyN_fwppC5Sfq4leazeZ1XotFqVEPKizoa2jV72xEeY0xjgL2k8TCmPy353ceElMXT0XVGECkiKKIS5un1RGswW8FovjUl36IbyFLhEbP5zvoWfbGU6BJpvcm6u-aOniu0kZS-xgfmygZ-CopjpXqSxjSQ73XSrGr99oWAso Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Domain-Id: None Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Domain-Name: None Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Identity-Status: Confirmed Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Is-Admin-Project: True Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Openstack-Nova-Api-Version: 2.92 Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Domain-Id: default Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Domain-Name: Default Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Project-Name: admin Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Role: member,admin,reader Sep 05 14:28:01.741702 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Roles: member,admin,reader Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f189779a37444439ac0c4ef7b42cc427"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f189779a37444439ac0c4ef7b42cc427"}]}] Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant: admin Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant-Id: f189779a37444439ac0c4ef7b42cc427 Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-Tenant-Name: admin Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User: admin Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Domain-Id: default Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Domain-Name: Default Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Id: 40eedd635c074248bf2c6c67ebf16bb0 Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: X-User-Name: admin Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: method: > Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: exception: Flavor 451 could not be found. Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: action_args: {'id': '451'} Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:28:01.743425 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:01.744440 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: ERROR nova.api.openstack.wsgi Sep 05 14:28:01.745726 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-cb929f7c-1c79-4b20-b5ac-46fe6b09a7d0 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106140) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:28:01.747004 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-cb929f7c-1c79-4b20-b5ac-46fe6b09a7d0 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012132 Sep 05 14:28:01.747004 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 27/52] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 5 14:28:01 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 05 14:28:02.697465 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:02.698467 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Sep 05 14:28:02.698891 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:28:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:03.218522 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-c91aacd5-3649-46fc-b261-385b9f011d7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:28:03.301532 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-c91aacd5-3649-46fc-b261-385b9f011d7b admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.463777 Sep 05 14:28:03.302076 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 28/54] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 5 14:28:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:28:04.263675 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:04.264677 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Sep 05 14:28:04.265073 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:28:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:04.778837 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-f5cd2d32-512a-40d4-a0a4-d6eff994b5e4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:28:04.854107 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-f5cd2d32-512a-40d4-a0a4-d6eff994b5e4 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.452315 Sep 05 14:28:04.854649 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 29/56] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 5 14:28:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:28:05.811448 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:05.812443 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001435 Sep 05 14:28:05.812834 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:28:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:06.330025 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-5f899c08-1b7c-4dc0-8f0e-7672c33aced8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:28:06.526234 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-5f899c08-1b7c-4dc0-8f0e-7672c33aced8 admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.578326 Sep 05 14:28:06.526807 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 30/58] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 5 14:28:05 2022] POST /compute/v2.1/flavors => generated 407 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:28:07.488190 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:07.489235 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 Sep 05 14:28:07.489623 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 29/59] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:28:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:07.998619 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-458904a1-b178-4d27-bc43-c04d4f7c379e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:28:08.079551 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-458904a1-b178-4d27-bc43-c04d4f7c379e admin admin] 10.222.0.15 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.453654 Sep 05 14:28:08.080030 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 31/60] 10.222.0.15 () {64 vars in 1235 bytes} [Mon Sep 5 14:28:07 2022] POST /compute/v2.1/flavors => generated 409 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:28:09.034084 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:09.035130 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001424 Sep 05 14:28:09.035513 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 30/61] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:28:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:28:09.553611 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-280d2570-e020-4e57-95df-2afa474c7121 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:28:09.574514 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-280d2570-e020-4e57-95df-2afa474c7121 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.405102 Sep 05 14:28:09.575076 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 32/62] 10.222.0.15 () {60 vars in 1202 bytes} [Mon Sep 5 14:28:09 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:29:02.540337 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:29:02.541393 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-46102aba-9f94-4573-aabf-0411a3936754 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001699 Sep 05 14:29:02.541796 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 31/63] 10.222.0.15 () {54 vars in 931 bytes} [Mon Sep 5 14:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:29:02.552714 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:02.938325 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-f6abbc5b-0184-4367-a235-3ea2b61977f9 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:29:02.960079 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-f6abbc5b-0184-4367-a235-3ea2b61977f9 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.411959 Sep 05 14:29:02.960613 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 33/64] 10.222.0.15 () {60 vars in 1292 bytes} [Mon Sep 5 14:29:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:29:02.981950 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG dbcounter [-] [106141] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=22,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=106141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:29:02.985719 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-1b3971ba-acb5-4f7b-8921-3f3d76be2471 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:29:02.993412 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-1b3971ba-acb5-4f7b-8921-3f3d76be2471 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012830 Sep 05 14:29:02.993919 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 32/65] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Sep 5 14:29:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:29:03.005825 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-7a46440b-1cee-464b-a1da-22e5d7f4820a admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:29:03.013389 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-7a46440b-1cee-464b-a1da-22e5d7f4820a admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011085 Sep 05 14:29:03.013898 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 34/66] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Sep 5 14:29:03 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:29:03.025726 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:29:03.034278 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012002 Sep 05 14:29:03.034843 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 33/67] 10.222.0.15 () {60 vars in 1286 bytes} [Mon Sep 5 14:29:03 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:29:03.045771 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-8e70acfd-2465-4cb5-a292-723a22fea823 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:29:03.053783 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-8e70acfd-2465-4cb5-a292-723a22fea823 admin admin] 10.222.0.15 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011454 Sep 05 14:29:03.054289 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 35/68] 10.222.0.15 () {60 vars in 1283 bytes} [Mon Sep 5 14:29:03 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:32:13.931719 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:13.932752 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 05 14:32:13.933146 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 34/69] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:32:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:32:14.074865 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_api:SELECT=6 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:32:14.234686 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:14.238363 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:14.238867 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:14.239300 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:14.240011 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:14.240460 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:14.240880 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:14.274322 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-282ec9fe-08b7-4bc2-9a2a-ff8a1082a401 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.201049 Sep 05 14:32:14.274897 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 36/70] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 5 14:32:14 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:32:15.093639 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:15.094638 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 05 14:32:15.095070 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 35/71] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:32:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:32:15.283525 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:15.288796 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:15.289274 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:15.289982 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:15.290762 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:15.291825 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:15.292616 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:15.317105 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-cac0894d-6745-40df-aea7-4d4fc857b79e admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.084355 Sep 05 14:32:15.317634 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 37/72] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 5 14:32:15 2022] GET /compute/v2.1/os-services => generated 791 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:32:26.566382 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:26.567415 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 05 14:32:26.567814 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 36/73] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:32:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:32:26.709441 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_cell0:SELECT=4 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:32:26.710168 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_cell1:SELECT=4 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:32:26.711055 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG dbcounter [-] [106140] Writing DB stats nova_api:SELECT=8 {{(pid=106140) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:32:26.759134 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:26.762530 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:26.763047 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:26.763481 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:26.764190 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:26.764660 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:26.765074 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:26.791766 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-a36dc674-9a18-4cfd-8311-94479ea2a319 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.086615 Sep 05 14:32:26.792248 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 38/74] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 5 14:32:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:32:27.628802 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: DEBUG nova.api.openstack.wsgi [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] Calling method '>' {{(pid=106141) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:27.630353 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: INFO nova.api.openstack.requestlog [None req-dd43e364-a747-4926-975b-51ffbfbcd936 admin admin] 10.222.0.15 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001948 Sep 05 14:32:27.630746 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: [pid: 106141|app: 0|req: 37/75] 10.222.0.15 () {56 vars in 1074 bytes} [Mon Sep 5 14:32:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:32:27.821983 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG nova.api.openstack.wsgi [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Calling method '>' {{(pid=106140) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:32:27.825498 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:27.825972 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:27.826395 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:27.827137 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:32:27.827581 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:32:27.827992 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: DEBUG oslo_concurrency.lockutils [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106140) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:32:27.849119 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: INFO nova.api.openstack.requestlog [None req-48fe3cf7-1a56-43ed-8eba-9e19de9921d6 admin admin] 10.222.0.15 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.080214 Sep 05 14:32:27.849599 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: [pid: 106140|app: 0|req: 39/76] 10.222.0.15 () {60 vars in 1193 bytes} [Mon Sep 5 14:32:27 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:33:26.569521 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: Mon Sep 5 14:33:26 2022 - graceful shutdown triggered... Sep 05 14:33:26.568819 dv-cinder-842905-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 05 14:33:26.570563 dv-cinder-842905-3-iscsi devstack@n-api.service[106140]: Gracefully killing worker 1 (pid: 106140)... Sep 05 14:33:26.570990 dv-cinder-842905-3-iscsi devstack@n-api.service[106141]: Gracefully killing worker 2 (pid: 106141)... Sep 05 14:33:27.569814 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: worker 1 buried after 1 seconds Sep 05 14:33:27.570356 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: worker 2 buried after 1 seconds Sep 05 14:33:27.570356 dv-cinder-842905-3-iscsi devstack@n-api.service[106139]: goodbye to uWSGI. Sep 05 14:33:27.571453 dv-cinder-842905-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 05 14:33:27.571997 dv-cinder-842905-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 05 14:33:27.574811 dv-cinder-842905-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 05 14:33:27.585815 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Sep 5 14:33:27 2022] *** Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: nodename: dv-cinder-842905-3-iscsi Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: machine: x86_64 Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: clock source: unix Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: pcre jit disabled Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: detected number of CPU cores: 4 Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: current working directory: / Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: detected binary path: /usr/bin/uwsgi-core Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: your processes number limit is 47680 Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: your memory page size is 4096 bytes Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: detected max file descriptor number: 2048 Sep 05 14:33:27.588205 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: lock engine: pthread robust mutexes Sep 05 14:33:27.589267 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: thunder lock: enabled Sep 05 14:33:27.589267 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 05 14:33:27.589267 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 05 14:33:27.627390 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: Python main interpreter initialized at 0x55dc492a99c0 Sep 05 14:33:27.627390 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: python threads support enabled Sep 05 14:33:27.627390 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: your server socket listen backlog is limited to 100 connections Sep 05 14:33:27.627390 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: your mercy for graceful operations on workers is 90 seconds Sep 05 14:33:27.627791 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: mapped 403077 bytes (393 KB) for 2 cores Sep 05 14:33:27.627862 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: *** Operational MODE: preforking *** Sep 05 14:33:27.629453 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: *** uWSGI is running in multiple interpreter mode *** Sep 05 14:33:27.629453 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: spawned uWSGI master process (pid: 127589) Sep 05 14:33:27.628809 dv-cinder-842905-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 05 14:33:27.643185 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: spawned uWSGI worker 1 (pid: 127608, cores: 1) Sep 05 14:33:27.643185 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: spawned uWSGI worker 2 (pid: 127609, cores: 1) Sep 05 14:33:27.643185 dv-cinder-842905-3-iscsi devstack@n-api.service[127589]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 05 14:33:28.294059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 14:33:28.294678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 05 14:33:29.452987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:33:29.452987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: from cryptography.utils import int_from_bytes Sep 05 14:33:29.453660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:33:29.453660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: from cryptography.utils import int_from_bytes Sep 05 14:33:29.475402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:33:29.475402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: from cryptography.utils import int_from_bytes Sep 05 14:33:29.476017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 05 14:33:29.476017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: from cryptography.utils import int_from_bytes Sep 05 14:33:31.859701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 14:33:31.860425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 14:33:31.860522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 14:33:31.860868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 14:33:31.861124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 14:33:31.861515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.861844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.862172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.862528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.862885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.863202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.863526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.863848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.864177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.864441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.864763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.865252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842905-3-iscsi {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.865584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.865897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.866218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.866544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.866877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.867207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.867528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.868036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.868474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.868785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.869100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.869456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.869761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.870076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.870396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.870707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.871071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.871386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.871865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842905-3-iscsi {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.872262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.872564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.873095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.873667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.873989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.874298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.874622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.874982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.875298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.875629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.875954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.876277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.876604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.876909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.877219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.877530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.877854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.878681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.879017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.879284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.879582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.879957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.880285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.880653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.880908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.881193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.881518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.881842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.882152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.882509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.882839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.883203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.883511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.883700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 05 14:33:31.884171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.884337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 05 14:33:31.884483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.884597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 05 14:33:31.884689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.884815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 05 14:33:31.884913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.885075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 05 14:33:31.885186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.885448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.885551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.885757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.885864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.886077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.886179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.886404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.886508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.886715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.886836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.887052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.887156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.887396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.887492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.887713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.887816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.888946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842905-3-iscsi {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.889993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.890219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.890322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.890525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.890627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.890773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.890920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.891104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.891240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.891410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.891730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.891835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.892948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.893047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.893255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.893367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.893654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.894282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.894442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.894534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.894760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.894896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.895097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.895197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.895407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.895523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.895717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.895831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842905-3-iscsi {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.896962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.897134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.897294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.897578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.897735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.897873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.897973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.898180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.898301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.898489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.898636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.898831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.898990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.899145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.899326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.899453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.899726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.899846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.899977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.900087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.900304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.900409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.900613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.900718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.900928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.901969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.902171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.902264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.902427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.902528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.902743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.902880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.903982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.904994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.905204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.905352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.905518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.905619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.905830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.905934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.906143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.906459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.906862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.907055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.907256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.907419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.907596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.907741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.907892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.908035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.908230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.908386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.908599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.908759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.908919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.909066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.909264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.909429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.909601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.15 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.910120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.910274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.15 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.910424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.910566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.910718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.910718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.911050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.911207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.911359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.911359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.911645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.911645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.911913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.912069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.912210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.912360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.912522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.912522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.912798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.912950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.913091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.913230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.913383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.913524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.913688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.913926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.914083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.914240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.914382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.914382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.914777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.915018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.915178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.915334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.915486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.915628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.915776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.915776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.916157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.916331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.916475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.916623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.916764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.916913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.917068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.917224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.917224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.917513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.917661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.917808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.917958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.918102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.918250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.918390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.918538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.918686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.918864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.919024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.919166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.919352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.919505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.919646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.919829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.920303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.920464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.920606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.920747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.920896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.921048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.921198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.921357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.921514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.921663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.921811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.921953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.922095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.922236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.922408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.922631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.922820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.922985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.923128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.923285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.923446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.923588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.923728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.923885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.924111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.924298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.924460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.924602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.924750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.924947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.925098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.925246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.925415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.925565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.925715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.925864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.926025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.926238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.926403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.926546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.926695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.926858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.927007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.927159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.927315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.927469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.927469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.927754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.927895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.928051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.928203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.928345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.928496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.928637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.928778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.928928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.929076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.929218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.929379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.929522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.929670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.929825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.929973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.930442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.930598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 05 14:33:31.930741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.930904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.931947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.932975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.933116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.933273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.933432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.933587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.933729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.933870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.934011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.934239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.934387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.934543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.934685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.934924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.935076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.935218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.935472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.935638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.935789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.935940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.936089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.936322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.936486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.936635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.936776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.936918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.937981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.938142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.938302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.938444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.938444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.938710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.938873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.939962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.940105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.941108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.941274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.941425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.941567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.941720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.941720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.942943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.943966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.944115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.944363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.944511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.944652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.944801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.944950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.945099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.945252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.945420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.945576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.945723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.945875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.946016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.946166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.946533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.946692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.946851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.947938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.948980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.949165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.949308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.949450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.949599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.949741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.949896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.950038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.950187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.950363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.950673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.950849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.951013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.951338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.951497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.951642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.951800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.951959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.952113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.952278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.952278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.952584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.952736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.952890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.953932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.954074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.954222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.954380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.954569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.954734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.954912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.955056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.955216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.955371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.955522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.955681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.955841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.957992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.958073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.958073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.958453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.958587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.958726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.958726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.959915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.960860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.961749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.962925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.963902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.964114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.964210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.964422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.964596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.964732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.964835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.965041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.965142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.965394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.965502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.965796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.965904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.966988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.967085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.967309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.967405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.967624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.967730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.967937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.968978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.969201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.969304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.969511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.969602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.969821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.969928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.970135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.970230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.970461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.970563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.970776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.970909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.971122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.971270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.971438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.971576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.971770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.971878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.972087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.972181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.972402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.972510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.972721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.972976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.973078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.973311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.973413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.973630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.973738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.973953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.974047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.974270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.974373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.974599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.974701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.974938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.975049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.975263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.975372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.975576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.975679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.975924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.976909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.977120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.977215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.977428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.977536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.977735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.977840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.978996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.979090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.979302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.979402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.979609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.979722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.979941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.980933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.981156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.981247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.981464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.981566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.981770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.981867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.982084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.982218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.982410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.982514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.983216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.983417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.983597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.983752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.983914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.984076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.984249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.984401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.984566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.984718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.984884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.985044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.985205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.985364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.985516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.985681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.985848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.986965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.987205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.987548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.987684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.987872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.987976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.988192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.988288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.988508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.988613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.988836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.988939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.989154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.989249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.989470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.989565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.989787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.989891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.990106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.990210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.990423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.990519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.990739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.990882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.991084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.991187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.991397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.991508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.991720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.991827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.992134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.992252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.992330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.992445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.992647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.992761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.993037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.993145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.993364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.993651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.993754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.993971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.994065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.994284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.994380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.994603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.994698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.994946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.995057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.995256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.995426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.995588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.995693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.995904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.996960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.997145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.997247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.997452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.997550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.997766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.997867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.998077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.998179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.998388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.998491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.998693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.998817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.999046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.999304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.999413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.999652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.999776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:31.999960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.000097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.000274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.000414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.000582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.000730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.000890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.001053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.001195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.001367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.001501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.001689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.001807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.002002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.002179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.002333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.002429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.002650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.002744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.003509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.003664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.003830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.003926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.004144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.004246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.004497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.004606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.004812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.004907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.005157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.005257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.005479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.005582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.005809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.005905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.006125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.006219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.006442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.006537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.006757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.007105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.007426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.007743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.008060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.008368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.008674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.009000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.009132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.009315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.009630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.009955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.010281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.010606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.010938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.011253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.011565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.011666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.011876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.012011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.012191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.012673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.012996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.013736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.013736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.013994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.014341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.014490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.014607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.014898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.015944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.016135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.016269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.016444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.016566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.016784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.016925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.017046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.017173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.017361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.017483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.017667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.017796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.018150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.018479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.019372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.019644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.019765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.020971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.021079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.021288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.021384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.021619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.021715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.021937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.022071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.022257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.022371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.022579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.022734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.022914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.023090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.023505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.023616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.023837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.023944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.024154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.024261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.024470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.024568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.024794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.024891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.025138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.025245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.025442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.025546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.025755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.025850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.026067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.026170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.026386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.026489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.026701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.026819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.027065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.027162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.027381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.027584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.027745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.027940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.028052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.028234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.028364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.028611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.028734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.028950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.029269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.029371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.029602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.029701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.029932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.030044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.030265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.030362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.030577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.030674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.030914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.031030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.031235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.031338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.031561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.031776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.031870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.032085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.032190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.032457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.032556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.032826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.033362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.033362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.033756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.033906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.034066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.034830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.035940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.036089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.036244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.036394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.036550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.036709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.036866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.037917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.038109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.038259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.038415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.039964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.040114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.040269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.040418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.040566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.040723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.040885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.041962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.042109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.042272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.042440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.042673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.042929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.043098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.043259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.043417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.043565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.043825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.043980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.044128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.044287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.044455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.044605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.044761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.044919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.045068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.045216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.045389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.045556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.045720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.045879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.046976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.047127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.047287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.047455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.047611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.047767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.047916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.048129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.048289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.048438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.048596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.048761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.049251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.049425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.049583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.049751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.050526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.050681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.050914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.051999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.052148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.052296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.052459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.052607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.052853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.053100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.053266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.053424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.053589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.053745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.054971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.055129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.055286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.055436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.055584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.055739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.055898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.056985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.057133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.057281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.057438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.057596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.057753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.057901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.058048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.058239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.058400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.058566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.058738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.058920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.059417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.059577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.059725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.059884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.060975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.061134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.061282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.061431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.061595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.061595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.061885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.062042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.062198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.062355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.062583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.062736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.062979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.063230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.063400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.063560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.063754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.064903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.065186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.065186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.065527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.065695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.066023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.066174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.066331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.066489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.066659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.066878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.067981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.068138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.068327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.068481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.068647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.068811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.068961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.069131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.075152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.076041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.077305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.077492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.077650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.077821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.077821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.078120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.078120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.078481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.078652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.078832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.078991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.079153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.080227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.080402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.080563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.080726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.080726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.081021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.081242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.081399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.081399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.081708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.081866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.082016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.082617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.082865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.083978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.084744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.085891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.085891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.086185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.086185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.086185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.086185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.086185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.086185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.087818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.087990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.088140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.088297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.088499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.088662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.088821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.088979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.089128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.089284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.089284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.089945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.090118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.090376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.090548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.090835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.091806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.092111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.092261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.092417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.092566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.092724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.092881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.093985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.094153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.094484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.094650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.094966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.095125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.095276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.096541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.097303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.097489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.097652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.097810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.097969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.098147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.098317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.098529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.098685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.098852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.099009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.099176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.099340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.099492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.099665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.099665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.100297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.100575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.100759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.101763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.102938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.103940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.103940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.103940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.104406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.104819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.105006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.105267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.105503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.105655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.105812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.105961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.106921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.107223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.107431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.107601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.107752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.107914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.108072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.108234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.108395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.108552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.108759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.108927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.109077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.109249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.109407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.109556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.109715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.109887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.110271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.110441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.110441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.110725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.111959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.113621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.113797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.113958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.114158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.114158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.114467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.114672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.115019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.115181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.115445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.115603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.115753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.115912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.116061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.116219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.116376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.116532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.116690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.116839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.117010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.117168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.117326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.117477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.117636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.117786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.118204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.118492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.118693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.118868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.119035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.119194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.119382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.119555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.119736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.119956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.120136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.120520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.120688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.120846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.120995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.121331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.121496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.121646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.121802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.121964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.122113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.122274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.122538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.122693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.122871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.123964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.124132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.124289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.124444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.124602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.124751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.124908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.125237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.125402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.125659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.125814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.125971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.126130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.126301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.126459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.126608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.126766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.126953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.127117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.127274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.127439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.127596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.127810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.127810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.128193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.128344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.128505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.128505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.128832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.128832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.129142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.129310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.129463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.129612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.129760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.129918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.130081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.130241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.130408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.130904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.131077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.131266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.131599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.131759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.131919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.132076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.132232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.132392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.132549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.132707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.132856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.133018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.133184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.133917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.134078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.134236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.134394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.134558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.134718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.134950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.135104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.135104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.135588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.135853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.136110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.136267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.136425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.136582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.136732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.136888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.137050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.137275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.137427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.137584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.137741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.137897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.138061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.138231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.138565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.138956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.139114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.139283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.139447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.139605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.139763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.139920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.140077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.140305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.140458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.140874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.141041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.141191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.141351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.141704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.141863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.142996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.143167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.143325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.143490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.144208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.144369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.144520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.144670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.144818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.144981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.145131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.145286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.145629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.146442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.146614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.146850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.147950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.148106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.148254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.148412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.148587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.148738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.148897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.149101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.149259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.149409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.149645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.149814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.149968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.150115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.150271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.150435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.150595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.150998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.151157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.151306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.151466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.151725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.152176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.153387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.153548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.153697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.153853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.154574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.155081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.155235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.155400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.155400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.155877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.156136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.156292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.156292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.156292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.156292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.156292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.157974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.158124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.158290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.158446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.158596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.158744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.158927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.159129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.159948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.159948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.159948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.160401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.160551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.160698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.161298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.161509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.161509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.161814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.161814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127609) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.162610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.169015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.170296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.171801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.173158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.174375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.175795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.175795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.175795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.175795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 05 14:33:32.175795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127608) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 05 14:33:32.214249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO dbcounter [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Registered counter for database nova_api Sep 05 14:33:32.231966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO dbcounter [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Registered counter for database nova_api Sep 05 14:33:32.235438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.242051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writer thread running {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.254225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_db.sqlalchemy.engines [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.260951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writer thread running {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.299344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.context [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e0c2985-b818-4cf9-b8fa-977a4355658f(cell1) {{(pid=127609) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 14:33:32.303473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:33:32.303948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:33:32.305519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:33:32.306260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:33:32.306710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:33:32.308745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:33:32.310746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO dbcounter [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Registered counter for database nova_cell0 Sep 05 14:33:32.314876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO dbcounter [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Registered counter for database nova_cell1 Sep 05 14:33:32.318441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.context [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),8e0c2985-b818-4cf9-b8fa-977a4355658f(cell1) {{(pid=127608) load_cells /opt/stack/nova/nova/context.py:464}} Sep 05 14:33:32.322178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.322598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:33:32.323114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:33:32.323966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.324725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:33:32.325486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:33:32.325935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:33:32.327992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:33:32.329590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writer thread running {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.330012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO dbcounter [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Registered counter for database nova_cell0 Sep 05 14:33:32.334745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO dbcounter [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Registered counter for database nova_cell1 Sep 05 14:33:32.335358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writer thread running {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.342242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_db.sqlalchemy.engines [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.344374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_db.sqlalchemy.engines [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.352833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writer thread running {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.353176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writer thread running {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.481459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO dbcounter [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Registered counter for database nova_cell0 Sep 05 14:33:32.488481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_db.sqlalchemy.engines [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127609) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.493150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writer thread running {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.503640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO dbcounter [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Registered counter for database nova_cell0 Sep 05 14:33:32.510348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_db.sqlalchemy.engines [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127608) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 05 14:33:32.514762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writer thread running {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 05 14:33:32.812405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: WARNING keystonemiddleware.auth_token [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:33:32.820305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: WARNING keystonemiddleware.auth_token [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:33:32.833872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: WARNING keystonemiddleware.auth_token [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:33:32.841447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: WARNING keystonemiddleware.auth_token [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:33:33.165381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: WARNING keystonemiddleware.auth_token [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:33:33.172018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: WARNING keystonemiddleware.auth_token [None req-5eb428e5-7a59-47e6-9e9b-561f72babe46 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:33:33.178052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc492a99c0 pid: 127609 (default app) Sep 05 14:33:33.184268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: WARNING keystonemiddleware.auth_token [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 05 14:33:33.190246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: WARNING keystonemiddleware.auth_token [None req-2696d15c-c6a6-4484-9b5b-0490fb928a71 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 05 14:33:33.196178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55dc492a99c0 pid: 127608 (default app) Sep 05 14:34:09.542914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:09.543906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:09.545266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:09.546192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:10.720096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-26d522c1-9d11-4969-9bbc-401f1d2fc5c8 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Action: 'create', calling method: .version_select at 0x7fb19244f310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1195598078", "metadata": {"Type": "work"}}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:10.847470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:10.848814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:10.853340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:10.854393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:12.132448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7068127e-43a7-4a92-8d3b-8597ac247220 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Action: 'create', calling method: .version_select at 0x7fb19244d310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1466181469"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:13.514769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-26d522c1-9d11-4969-9bbc-401f1d2fc5c8 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.993109 Sep 05 14:34:13.525907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1/1] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 5 14:34:09 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4003 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 05 14:34:13.532906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cf4fae60-d286-4431-bd08-6adbec08adce tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb1923301f0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:13.667078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cf4fae60-d286-4431-bd08-6adbec08adce tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 200 len: 353 microversion: 2.1 time: 0.138252 Sep 05 14:34:13.674758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 2/2] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:13 2022] GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 353 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:14.431205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7068127e-43a7-4a92-8d3b-8597ac247220 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.593702 Sep 05 14:34:14.433259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1/3] 10.222.0.15 () {60 vars in 1155 bytes} [Mon Sep 5 14:34:10 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3598 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 05 14:34:14.450018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-12dd3064-12f5-4bf4-80da-9cb61fb77092 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1923308b0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:14.567290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-12dd3064-12f5-4bf4-80da-9cb61fb77092 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 200 len: 345 microversion: 2.1 time: 0.121776 Sep 05 14:34:14.574082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 3/4] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:14 2022] GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 345 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:14.683601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0b14dfe6-5473-4e5f-9035-0ba6d64b56e7 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb19232e1f0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:14.772930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0b14dfe6-5473-4e5f-9035-0ba6d64b56e7 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 200 len: 353 microversion: 2.1 time: 0.094008 Sep 05 14:34:14.773383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2/5] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:14 2022] GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 353 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:15.588241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-634a977f-74cf-43c7-86bd-5dce7265c4e7 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1922ba040>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:15.708106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-634a977f-74cf-43c7-86bd-5dce7265c4e7 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 200 len: 346 microversion: 2.1 time: 0.130171 Sep 05 14:34:15.708698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 4/6] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:15 2022] GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 346 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:15.724731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c2ec1fa-d633-42da-be51-fdd2b438a859 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Action: 'create', calling method: .version_select at 0x7fb19232e8b0>, body: {"snapshot": {"volume_id": "53717334-c4cf-4197-b78a-13de962f4fde", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1465555257"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:15.788319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2ef9e8b7-b490-4ef4-84c4-562119cb0a2c tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb192330dc0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:15.893584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2ef9e8b7-b490-4ef4-84c4-562119cb0a2c tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 200 len: 354 microversion: 2.1 time: 0.109139 Sep 05 14:34:15.895136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 5/7] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:15 2022] GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:34:15.907937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0978f5e2-2ffc-4519-89af-e049f964bd55 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb192330670>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:15.999154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0978f5e2-2ffc-4519-89af-e049f964bd55 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 200 len: 354 microversion: 2.1 time: 0.095120 Sep 05 14:34:16.000301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 6/8] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:15 2022] GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:34:16.014299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09af365b-f46c-4186-9c34-27f5b9a60487 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb1922ba3a0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:16.583658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09af365b-f46c-4186-9c34-27f5b9a60487 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 202 len: 0 microversion: 2.1 time: 0.567491 Sep 05 14:34:16.583658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 7/9] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:34:16 2022] DELETE /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:34:16.589970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b6931515-a246-445b-898b-1d3edfb3db51 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb1923303a0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:16.912042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c2ec1fa-d633-42da-be51-fdd2b438a859 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.192226 Sep 05 14:34:16.925638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b6931515-a246-445b-898b-1d3edfb3db51 tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 200 len: 353 microversion: 2.1 time: 0.340320 Sep 05 14:34:16.926972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 3/10] 10.222.0.15 () {60 vars in 1162 bytes} [Mon Sep 5 14:34:15 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:16.928686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 8/11] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:16 2022] GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 353 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:16.936892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c1275f73-3598-45da-8867-f0e6f21619f1 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1922b7af0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:17.032621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c1275f73-3598-45da-8867-f0e6f21619f1 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.104242 Sep 05 14:34:17.040331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 4/12] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:16 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:17.051546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-914e08d1-d7e1-4836-b6f4-07b5ea5103ca tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb192330820>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:17.138175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-914e08d1-d7e1-4836-b6f4-07b5ea5103ca tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.096694 Sep 05 14:34:17.140902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 9/13] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Sep 5 14:34:17 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:34:17.154460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f532a844-8101-44e6-b55b-00888c519f57 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb19232ee50>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:17.223047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f532a844-8101-44e6-b55b-00888c519f57 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.073141 Sep 05 14:34:17.224335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 5/14] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:17 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:17.941903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-42870356-224f-45d3-a628-dbc5cc0f50db tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Calling method '.version_select at 0x7fb1922bab80>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:17.985490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-42870356-224f-45d3-a628-dbc5cc0f50db tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] HTTP exception thrown: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-42870356-224f-45d3-a628-dbc5cc0f50db tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Request method failure captured: Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 HTTP/1.1 Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjhcJWNfCe-l2XwsJ_pqMJquMLOU9mcxmWSbE_pKZlM32-UV0fsUZT1Wmesyb4fO6BGWFxextoPaM_eDoo-rlDhf3JHDzeoSy89dr8RwxT_Ri4LQ3TtWE2J0kSGCmsUlQxCwuzsoPrnmYkzqyn1o4_6GLFGNdcx2B-zubGjChIZ7ug Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 108a6003407b4b03ab30834f2af7d66c Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesGetTestJSON-1869890789 Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:34:17.988173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/108a6003407b4b03ab30834f2af7d66c"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/108a6003407b4b03ab30834f2af7d66c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/108a6003407b4b03ab30834f2af7d66c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_108a6003407b4b03ab30834f2af7d66c"}]}] Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesGetTestJSON-1869890789 Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 108a6003407b4b03ab30834f2af7d66c Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesGetTestJSON-1869890789 Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesGetTestJSON-1869890789-project Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c4f885036f6b4f9c8748666d9ecf6219 Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesGetTestJSON-1869890789-project Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '89abe1d9-1c5a-41d1-8905-64e86041e240'} Sep 05 14:34:17.989423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. (HTTP 404) (Request-ID: req-a540018f-2122-49b2-b8ea-6ba4dd9cf815) Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:17.990149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:17.994648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 14:34:17.995934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-42870356-224f-45d3-a628-dbc5cc0f50db tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] Returning 404 to user: Volume 89abe1d9-1c5a-41d1-8905-64e86041e240 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-42870356-224f-45d3-a628-dbc5cc0f50db tempest-VolumesGetTestJSON-1869890789 tempest-VolumesGetTestJSON-1869890789-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240" status: 404 len: 109 microversion: 2.1 time: 0.052177 Sep 05 14:34:17.998896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 10/15] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:17 2022] GET /compute/v2.1/os-volumes/89abe1d9-1c5a-41d1-8905-64e86041e240 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:34:18.236061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-21c004a9-5171-4431-adac-6f8ed37c0c9a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb19232e700>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:18.280763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-21c004a9-5171-4431-adac-6f8ed37c0c9a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.048285 Sep 05 14:34:18.285908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 6/16] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:18 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:19.293809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a1511d1f-4493-4a3d-a530-fd66b6a0651e tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1922ba5e0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:19.372043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a1511d1f-4493-4a3d-a530-fd66b6a0651e tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.081461 Sep 05 14:34:19.373868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 11/17] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:19 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:20.389210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7fd63aa8-c0a6-40c7-babe-4a96fad95292 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1922ba1f0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:20.450030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7fd63aa8-c0a6-40c7-babe-4a96fad95292 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.067618 Sep 05 14:34:20.456564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 12/18] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:20 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:20.592068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-22c5112f-4af4-474e-93f6-5b4d66c83577 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: .version_select at 0x7fb19232e040>, body: {"keypair": {"name": "tempest-keypair-403777729", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJNKi+m8q2GmCpY59UQop0C0a9hzu3XHGvlKfwDXD6dQhsH2kuHwa4cwY6baEpb03UpZxkPlX2kBONE5OdATtznorH4mh0IPgGAjHUZLQp2Uh1OcIJJ0vUDMRLVJ3SbFsA=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:20.765586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-22c5112f-4af4-474e-93f6-5b4d66c83577 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:20.776060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-22c5112f-4af4-474e-93f6-5b4d66c83577 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:21.013969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-22c5112f-4af4-474e-93f6-5b4d66c83577 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.957720 Sep 05 14:34:21.014583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 7/19] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:34:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:21.466040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a8eb783b-2b4d-434d-be03-8e348da6cefc tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb192c7e700>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:21.558011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a8eb783b-2b4d-434d-be03-8e348da6cefc tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.097214 Sep 05 14:34:21.559059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 13/20] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:21 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:22.572629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6bae59fa-24d5-447c-b051-52243fa14f0e tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb19229a670>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:22.729720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6bae59fa-24d5-447c-b051-52243fa14f0e tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.161764 Sep 05 14:34:22.730652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 8/21] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:22 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:23.745653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fe89739a-755c-4a25-a638-c0ba75805dc6 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1922a4280>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:23.824665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fe89739a-755c-4a25-a638-c0ba75805dc6 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 288 microversion: 2.1 time: 0.084606 Sep 05 14:34:23.825430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 14/22] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:23 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 288 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:23.837277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0816b8e2-16da-4fa7-8231-5db146dbee95 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb19229aca0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:24.065109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-755418376", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:24.082481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0816b8e2-16da-4fa7-8231-5db146dbee95 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "DELETE /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 202 len: 0 microversion: 2.1 time: 0.249031 Sep 05 14:34:24.092898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 9/23] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Sep 5 14:34:23 2022] DELETE /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:34:24.092898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a59921c8-f034-452c-9701-f2f88a0172da tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1922423a0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:24.135207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a59921c8-f034-452c-9701-f2f88a0172da tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 200 len: 287 microversion: 2.1 time: 0.046984 Sep 05 14:34:24.136475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 10/24] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:24 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 287 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:24.336912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] validate_networks() for [('5252f8af-c73a-406a-9ef0-2603b8718d5e', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:34:25.155498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4571f1b5-9b2a-43d0-a42a-8bfc22f2b6ad tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb19229af70>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:25.221474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-4571f1b5-9b2a-43d0-a42a-8bfc22f2b6ad tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] HTTP exception thrown: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4571f1b5-9b2a-43d0-a42a-8bfc22f2b6ad tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Request method failure captured: Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 HTTP/1.1 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjiv8hmWWXN04NsCjZ7a77iVy63H-y2N_q3XeTVm76wQJS3Rwmqu88qn8L3KwwNeRyLaen57A_L1DogYCT_M1z3ISSkyMZx2EKzXCqg4dEHoIDxRkpseDd6bHLnsVWJmYwm71HBuuP8PoYbdT7M3r6DsO4T55BRjOYMqaK_tr9Hwc0 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:34:25.233807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_11dfac0c6f8f47b9a02dbcc53db203e4"}]}] Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: bbb6b8c6d8d04e72a1fc06dfa2bb3692 Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '0a0efc7b-b0dc-4436-8428-63cbfb06e714'} Sep 05 14:34:25.235258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. (HTTP 404) (Request-ID: req-836c9611-1612-43a1-b5cf-f34242c42a75) Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.236131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:25.237835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 05 14:34:25.238993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. Sep 05 14:34:25.240214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:34:25.249202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4571f1b5-9b2a-43d0-a42a-8bfc22f2b6ad tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Returning 404 to user: Snapshot 0a0efc7b-b0dc-4436-8428-63cbfb06e714 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:34:25.250258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4571f1b5-9b2a-43d0-a42a-8bfc22f2b6ad tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714" status: 404 len: 111 microversion: 2.1 time: 0.105596 Sep 05 14:34:25.250902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 11/25] 10.222.0.15 () {58 vars in 1251 bytes} [Mon Sep 5 14:34:25 2022] GET /compute/v2.1/os-snapshots/0a0efc7b-b0dc-4436-8428-63cbfb06e714 => generated 111 bytes in 107 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 14:34:25.260185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0aec9a5-01a8-42ef-97d6-d1156e3b3fbf tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb192c7c700>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:25.522692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0aec9a5-01a8-42ef-97d6-d1156e3b3fbf tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 202 len: 0 microversion: 2.1 time: 0.266796 Sep 05 14:34:25.523358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 12/26] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:34:25 2022] DELETE /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:34:25.541974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cfc29358-4f90-446f-b98a-be22a63b83b6 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb19229aca0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:25.689649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cfc29358-4f90-446f-b98a-be22a63b83b6 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 200 len: 345 microversion: 2.1 time: 0.158838 Sep 05 14:34:25.692152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 13/27] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:25 2022] GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 345 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:25.703461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6d4e11c7-4b87-4482-a200-171b99919d95 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb192229310>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:25.770455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6d4e11c7-4b87-4482-a200-171b99919d95 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/4268b8cb-c20a-4c70-bebb-a17c29048961" status: 200 len: 350 microversion: 2.1 time: 0.077058 Sep 05 14:34:25.780023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 14/28] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:25 2022] GET /compute/v2.1/os-volumes/4268b8cb-c20a-4c70-bebb-a17c29048961 => generated 350 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:26.132662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:34:26.133223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:34:26.133722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:34:26.134155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:34:26.134559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:34:26.166235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:26.166710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:26.169187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:26.172189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:26.172674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:26.174522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:26.228449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88bcd0e4-c24d-48de-8cc6-d0023816cca5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'create', calling method: .version_select at 0x7fb1922299d0>, body: {"keypair": {"name": "tempest-keypair-1966763067", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDgtgswgNaUN5rwxQ2acEW9ydEqLsZVdya18tMgTq3ntvMCigIAcNm4h06glGGsRJJNV1HOVv0DS4BrHrarKdxAPWgJ3twTbxOAxqHd2OqyjaWdbPM/F2SLTvWM24Rz49A=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:26.253773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for project 2af009055e3b4bdda73a770242253b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:26.262273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-88bcd0e4-c24d-48de-8cc6-d0023816cca5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for project 834730ab3cfd4d649fc270843d47b291. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:26.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-88bcd0e4-c24d-48de-8cc6-d0023816cca5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for user 91c691b6a7724d708bfc7424908516c8 and project 834730ab3cfd4d649fc270843d47b291. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:26.273139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for user 9136f02e6c664f27b3f4fd35475f0eea and project 2af009055e3b4bdda73a770242253b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:26.298949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:34:26.308393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:34:26.468428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88bcd0e4-c24d-48de-8cc6-d0023816cca5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.457647 Sep 05 14:34:26.473004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 15/29] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Sep 5 14:34:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 463 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 14:34:26.560240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-44959486-900c-4a94-bbfc-9b7633894508 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.702279 Sep 05 14:34:26.564291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 15/30] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:34:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:34:26.578344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f491577f-2e9e-4136-aba8-18e3a77a5c37 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:26.579131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f491577f-2e9e-4136-aba8-18e3a77a5c37 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:26.712577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f294d348-6784-4377-8786-860bd0425533 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1921a1ee0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:26.886338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-f294d348-6784-4377-8786-860bd0425533 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] HTTP exception thrown: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f294d348-6784-4377-8786-860bd0425533 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Request method failure captured: Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde HTTP/1.1 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjiv8hmWWXN04NsCjZ7a77iVy63H-y2N_q3XeTVm76wQJS3Rwmqu88qn8L3KwwNeRyLaen57A_L1DogYCT_M1z3ISSkyMZx2EKzXCqg4dEHoIDxRkpseDd6bHLnsVWJmYwm71HBuuP8PoYbdT7M3r6DsO4T55BRjOYMqaK_tr9Hwc0 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:34:26.888427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_11dfac0c6f8f47b9a02dbcc53db203e4"}]}] Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: bbb6b8c6d8d04e72a1fc06dfa2bb3692 Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '53717334-c4cf-4197-b78a-13de962f4fde'} Sep 05 14:34:26.889826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. (HTTP 404) (Request-ID: req-6fb0c886-44e0-441c-bb82-c05dab23c6e0) Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:26.890515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:26.891502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 14:34:26.892430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f294d348-6784-4377-8786-860bd0425533 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Returning 404 to user: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:34:26.894166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f294d348-6784-4377-8786-860bd0425533 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 404 len: 109 microversion: 2.1 time: 0.182187 Sep 05 14:34:26.903178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 16/31] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:26 2022] GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 109 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:34:26.913244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-26a0b0b8-1f3b-429c-a08e-69514b8ac124 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb192216b80>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:26.987957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-26a0b0b8-1f3b-429c-a08e-69514b8ac124 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] HTTP exception thrown: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-26a0b0b8-1f3b-429c-a08e-69514b8ac124 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Request method failure captured: Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde HTTP/1.1 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjiv8hmWWXN04NsCjZ7a77iVy63H-y2N_q3XeTVm76wQJS3Rwmqu88qn8L3KwwNeRyLaen57A_L1DogYCT_M1z3ISSkyMZx2EKzXCqg4dEHoIDxRkpseDd6bHLnsVWJmYwm71HBuuP8PoYbdT7M3r6DsO4T55BRjOYMqaK_tr9Hwc0 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:34:26.990110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_11dfac0c6f8f47b9a02dbcc53db203e4"}]}] Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: bbb6b8c6d8d04e72a1fc06dfa2bb3692 Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '53717334-c4cf-4197-b78a-13de962f4fde'} Sep 05 14:34:26.991533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. (HTTP 404) (Request-ID: req-2fb9ea2f-4825-4c65-82be-04a326b1a951) Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:26.992364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 14:34:26.993714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 14:34:26.994951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-26a0b0b8-1f3b-429c-a08e-69514b8ac124 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Returning 404 to user: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:34:26.996299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-26a0b0b8-1f3b-429c-a08e-69514b8ac124 tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 404 len: 109 microversion: 2.1 time: 0.085749 Sep 05 14:34:26.999790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 17/32] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:34:26 2022] DELETE /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 14:34:27.013796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2becbe67-6d31-49d8-907d-fadb0d2bf96a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Calling method '.version_select at 0x7fb1919328b0>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:27.055179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f491577f-2e9e-4136-aba8-18e3a77a5c37 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:27.115659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-2becbe67-6d31-49d8-907d-fadb0d2bf96a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] HTTP exception thrown: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:27.117880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f491577f-2e9e-4136-aba8-18e3a77a5c37 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1221 microversion: 2.1 time: 0.510781 Sep 05 14:34:27.127859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 16/33] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:26 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1221 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2becbe67-6d31-49d8-907d-fadb0d2bf96a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Request method failure captured: Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde HTTP/1.1 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjiv8hmWWXN04NsCjZ7a77iVy63H-y2N_q3XeTVm76wQJS3Rwmqu88qn8L3KwwNeRyLaen57A_L1DogYCT_M1z3ISSkyMZx2EKzXCqg4dEHoIDxRkpseDd6bHLnsVWJmYwm71HBuuP8PoYbdT7M3r6DsO4T55BRjOYMqaK_tr9Hwc0 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:34:27.140930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/11dfac0c6f8f47b9a02dbcc53db203e4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_11dfac0c6f8f47b9a02dbcc53db203e4"}]}] Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 11dfac0c6f8f47b9a02dbcc53db203e4 Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-725437611 Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: bbb6b8c6d8d04e72a1fc06dfa2bb3692 Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesSnapshotsTestJSON-725437611-project Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '53717334-c4cf-4197-b78a-13de962f4fde'} Sep 05 14:34:27.145428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. (HTTP 404) (Request-ID: req-14c31447-17e3-4f1f-9795-bb57b70d4f98) Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:27.146226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 14:34:27.147611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 14:34:27.148730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:34:27.149907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2becbe67-6d31-49d8-907d-fadb0d2bf96a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] Returning 404 to user: Volume 53717334-c4cf-4197-b78a-13de962f4fde could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:34:27.151111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2becbe67-6d31-49d8-907d-fadb0d2bf96a tempest-VolumesSnapshotsTestJSON-725437611 tempest-VolumesSnapshotsTestJSON-725437611-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde" status: 404 len: 109 microversion: 2.1 time: 0.143674 Sep 05 14:34:27.151927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 18/34] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:26 2022] GET /compute/v2.1/os-volumes/53717334-c4cf-4197-b78a-13de962f4fde => generated 109 bytes in 152 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:34:27.670332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-317984044", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:28.059778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] validate_networks() for [('5252f8af-c73a-406a-9ef0-2603b8718d5e', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:34:28.890560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-992377510", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "networks": [{"uuid": "b8051544-65b4-4ff2-a728-2506ad01469f"}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:29.023064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] validate_networks() for [('b8051544-65b4-4ff2-a728-2506ad01469f', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:34:30.232990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:34:30.234221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:34:30.235065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:34:30.235688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:34:30.236933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:34:30.274177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:30.274177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:30.274177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:30.274177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:30.280579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:30.281792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:30.344552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for project 2af009055e3b4bdda73a770242253b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:30.353572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for user 9136f02e6c664f27b3f4fd35475f0eea and project 2af009055e3b4bdda73a770242253b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:30.382325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:34:30.385460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:34:30.535383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:34:30.539548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:34:30.540044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:34:30.540463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:34:30.540886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:34:30.556921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:30.557748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:30.558372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:30.559619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:30.560246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:30.560765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:30.584468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6013022e-9229-4608-a2ad-6bf75944b095 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.919297 Sep 05 14:34:30.585292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 17/35] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:34:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 2921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:34:30.590724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-37b5817d-aa10-42dd-ace4-85207d478b46 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb19216a8b0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:30.596642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Getting quotas for project 3c30f843007d4200ac64e2189003698f. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:30.611271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Getting quotas for user d31427f2a67e49d0b4d3e1b3cee8c48b and project 3c30f843007d4200ac64e2189003698f. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:30.659237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:34:30.684626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:34:30.759002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-37b5817d-aa10-42dd-ace4-85207d478b46 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/62015b8a-28d8-4107-945d-f461d0a30785" status: 200 len: 350 microversion: 2.1 time: 0.166409 Sep 05 14:34:30.759002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 18/36] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:30 2022] GET /compute/v2.1/os-volumes/62015b8a-28d8-4107-945d-f461d0a30785 => generated 350 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:30.759002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1981085858", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b1d20ee-7dc0-477b-93a5-81201fa15bc2"}], "security_groups": [{"name": "tempest-securitygroup--775337375"}], "key_name": "tempest-keypair-403777729", "user_data": "}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:31.009489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aea210f4-4aea-463a-8a69-66f8a2c6daf9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.911699 Sep 05 14:34:31.016149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 19/37] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:34:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 2919 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:34:31.045171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7a5fb218-2b9c-4bf2-957d-68ca9b5821d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:31.054516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7a5fb218-2b9c-4bf2-957d-68ca9b5821d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:31.178621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] validate_networks() for [('6b1d20ee-7dc0-477b-93a5-81201fa15bc2', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:34:31.220403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7a5fb218-2b9c-4bf2-957d-68ca9b5821d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:31.310296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7a5fb218-2b9c-4bf2-957d-68ca9b5821d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1221 microversion: 2.1 time: 0.286717 Sep 05 14:34:31.312611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 20/38] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:31 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1221 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:31.348918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22e0b754-39fa-4ca8-8ff9-64cae520504e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:31.355212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22e0b754-39fa-4ca8-8ff9-64cae520504e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:31.743993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-22e0b754-39fa-4ca8-8ff9-64cae520504e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:31.753708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22e0b754-39fa-4ca8-8ff9-64cae520504e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1214 microversion: 2.1 time: 0.440023 Sep 05 14:34:31.757218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:31 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1214 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:32.334451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-984879133", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4150a16-af6f-4e15-ada3-1b778d9ea7f0"}], "security_groups": [{"name": "tempest-securitygroup--1897806922"}], "key_name": "tempest-keypair-1966763067", "user_data": "}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:32.598034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:34:32.598583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:34:32.599057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:34:32.599473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:34:32.599883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:34:32.608839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] validate_networks() for [('b4150a16-af6f-4e15-ada3-1b778d9ea7f0', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:34:32.617416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:32.621348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:32.621348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:32.621348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:32.621348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:32.621653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:32.644140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:32.649601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:32.674738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:34:32.676949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:34:32.898573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2bcd8d8-42ee-44f4-a64c-333eb235582f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 2.143763 Sep 05 14:34:32.907849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 19/40] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:34:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 2154 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:34:32.950578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:32.953108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:32.994654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:32.999053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:32.999746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:33.000628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:33.007431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:33.007431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:33.425060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:34:33.426365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:34:33.427132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:34:33.427887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:34:33.431079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:34:33.443337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:33.444098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:33.444725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:33.445702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:33.446363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:33.447052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:33.452264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:33.470452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for project 834730ab3cfd4d649fc270843d47b291. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:34:33.487195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for user 91c691b6a7724d708bfc7424908516c8 and project 834730ab3cfd4d649fc270843d47b291. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:34:33.495607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7e12ce02-cc94-4bd2-a0a0-707eec46a285 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1225 microversion: 2.1 time: 0.581036 Sep 05 14:34:33.496608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 20/41] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:32 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1225 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:33.525918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:33.532329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:33.539351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:34:33.541883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:34:33.548488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:33.551115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:33.552856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:33.554072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:33.565244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:33.565244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:33.676966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:33.686190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7fa24f7a-f11f-42f3-85a8-01d9491c2228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1218 microversion: 2.1 time: 0.188160 Sep 05 14:34:33.687456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 21/42] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:33 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1218 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:33.693243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3103d5e-d4a4-47bc-baff-f7b470ff99e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:33.694094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3103d5e-d4a4-47bc-baff-f7b470ff99e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:33.776281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3103d5e-d4a4-47bc-baff-f7b470ff99e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:33.785985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3103d5e-d4a4-47bc-baff-f7b470ff99e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1241 microversion: 2.1 time: 0.096323 Sep 05 14:34:33.787421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 22/43] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:33 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1241 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:33.799761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a1f8961-61c2-4fdb-9a24-4df043426a32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.469723 Sep 05 14:34:33.802492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 22/44] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Sep 5 14:34:32 2022] POST /compute/v2.1/servers => generated 402 bytes in 1472 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 05 14:34:33.825404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-df2ad1fe-fd6d-4114-8548-10ad5ed659ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:33.826772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-df2ad1fe-fd6d-4114-8548-10ad5ed659ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:33.928428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df2ad1fe-fd6d-4114-8548-10ad5ed659ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:33.940603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df2ad1fe-fd6d-4114-8548-10ad5ed659ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:33.942068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df2ad1fe-fd6d-4114-8548-10ad5ed659ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:33.955008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-df2ad1fe-fd6d-4114-8548-10ad5ed659ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1281 microversion: 2.20 time: 0.132634 Sep 05 14:34:33.957251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1281 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:34.525174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:34.526418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:34.533370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:34.534078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:34.534443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:34.535042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:34.535655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:34.536080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:34.729044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:34.731282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:34.735322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:34.749530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8ef76731-910c-48b6-b5b2-f87c2b3e03c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1273 microversion: 2.1 time: 0.228988 Sep 05 14:34:34.752856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 23/46] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:34 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1273 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:34.769124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:34.769615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:34.770054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:34.770774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:34.771258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:34.771705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:34.822085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d73e02e9-9fe0-47ae-9989-6c05490f7bde tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:34.825735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d73e02e9-9fe0-47ae-9989-6c05490f7bde tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:34.879971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:34.889245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b9b24311-f4ce-4aa3-8ca7-2882e1ad4909 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1266 microversion: 2.1 time: 0.171968 Sep 05 14:34:34.892020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 24/47] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:34 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1266 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:34.945102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d73e02e9-9fe0-47ae-9989-6c05490f7bde tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:34.969259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d73e02e9-9fe0-47ae-9989-6c05490f7bde tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1241 microversion: 2.1 time: 0.157986 Sep 05 14:34:34.973652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:34 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1241 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:34.980054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a0b970e5-07bd-4bfd-9b4f-804eb4377fcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:34.980839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a0b970e5-07bd-4bfd-9b4f-804eb4377fcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:35.085221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a0b970e5-07bd-4bfd-9b4f-804eb4377fcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:35.106084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a0b970e5-07bd-4bfd-9b4f-804eb4377fcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:35.107763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a0b970e5-07bd-4bfd-9b4f-804eb4377fcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:35.109020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a0b970e5-07bd-4bfd-9b4f-804eb4377fcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1281 microversion: 2.20 time: 0.134275 Sep 05 14:34:35.109625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 25/49] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1281 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:35.209523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fade0354-8949-4358-beab-74e20184a8a8 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb191882940>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:35.302615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fade0354-8949-4358-beab-74e20184a8a8 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/d16ada92-370c-46e4-9409-92c58adb4cab" status: 200 len: 351 microversion: 2.1 time: 0.097226 Sep 05 14:34:35.303611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 25/50] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 14:34:35 2022] GET /compute/v2.1/os-volumes/d16ada92-370c-46e4-9409-92c58adb4cab => generated 351 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:35.318907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c3b33ca2-ef15-42c5-a843-8b113f239cc2 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb19185d700>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:35.535618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c3b33ca2-ef15-42c5-a843-8b113f239cc2 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.222279 Sep 05 14:34:35.536252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 26/51] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Sep 5 14:34:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:35.552491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-838d70e9-df5d-4c2b-8920-65db5b477f10 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb191899670>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:35.778046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:35.780198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:35.794638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:35.795884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:35.797639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:35.798155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-838d70e9-df5d-4c2b-8920-65db5b477f10 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.249425 Sep 05 14:34:35.799100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:35.800190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:35.800855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:35.807882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 26/52] 10.222.0.15 () {58 vars in 1149 bytes} [Mon Sep 5 14:34:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:35.813167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-de3f6faa-baf1-4adb-a1b1-ef2bf4fbdcf4 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb191899790>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:35.988267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:35.999322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88c8d21d-3a38-4caa-85b5-bb4b9d0a97a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1273 microversion: 2.1 time: 0.227113 Sep 05 14:34:36.002472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 27/53] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:35 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1273 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:36.032206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:36.032988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:36.051407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:36.053033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:36.053490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:36.055290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:36.058522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:36.059233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:36.183683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:36.185978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-09a6aa24-42e2-4a97-a9f1-62208f3c43ca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1274 microversion: 2.1 time: 0.163589 Sep 05 14:34:36.186812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 28/54] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:36 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1274 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:36.192273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:36.193079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:36.200245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:36.200735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:36.201227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:36.202101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:36.202971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:36.203535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:36.646196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:36.659986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a91283d-edc6-4ad7-a8ef-9a76837f5f2a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1237 microversion: 2.1 time: 0.471868 Sep 05 14:34:36.690338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 29/55] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:36 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1237 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:36.716955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:36.717575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:36.740169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:36.741056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:36.741897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:36.742829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:36.743531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:36.744131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:36.858373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:36.884702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:36.889877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:36.892323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-158ab864-53b5-4d8b-a714-82f9a35e8c9b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1277 microversion: 2.20 time: 0.197964 Sep 05 14:34:36.895844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 30/56] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1277 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:37.009355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-de3f6faa-baf1-4adb-a1b1-ef2bf4fbdcf4 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 1.199922 Sep 05 14:34:37.018896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 27/57] 10.222.0.15 () {58 vars in 1134 bytes} [Mon Sep 5 14:34:35 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 1210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:37.023998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0f46e157-509e-44f6-b837-ec99138b0d00 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb19185db80>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:37.029351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:37.030378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:37.037628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:37.038557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:37.039232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:37.040343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:37.041023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:37.041653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:37.210163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:37.226332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-788b0127-0366-4957-a684-7fdc0fcd71da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1279 microversion: 2.1 time: 0.200722 Sep 05 14:34:37.246742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 28/58] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:37 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1279 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:37.274210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:37.274859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:37.295052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:37.297643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:37.299721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:37.300479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:37.301027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:37.301455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:37.370580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0f46e157-509e-44f6-b837-ec99138b0d00 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.350710 Sep 05 14:34:37.371191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 31/59] 10.222.0.15 () {58 vars in 1167 bytes} [Mon Sep 5 14:34:37 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:34:37.386178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b836e02a-1b2c-4420-9dcb-91a0e35f5882 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb1920fe160>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:37.630747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b836e02a-1b2c-4420-9dcb-91a0e35f5882 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.239104 Sep 05 14:34:37.631905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 32/60] 10.222.0.15 () {58 vars in 1170 bytes} [Mon Sep 5 14:34:37 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:37.648855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-887b8000-9e58-4410-953c-24a62bfda159 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb1917fb550>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:37.893977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-887b8000-9e58-4410-953c-24a62bfda159 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.249160 Sep 05 14:34:37.896044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 33/61] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Sep 5 14:34:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:37.909314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:37.911274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:37.920310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:37.921124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:37.927136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:37.927136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:37.927136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:37.927136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:38.008287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:38.026528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6db3577f-ae28-46ee-8a79-fb3dbf099ef2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1272 microversion: 2.1 time: 0.770417 Sep 05 14:34:38.030075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 29/62] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:37 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1272 bytes in 782 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:38.081731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f9057781-ab4f-4fd3-99fc-262e39b61b93 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb191871160>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:38.196341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:38.254554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-75ef5fe8-4a02-45ac-9cbc-c6f851e547c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1301 microversion: 2.1 time: 0.354961 Sep 05 14:34:38.255752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 34/63] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:37 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1301 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:38.262579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:38.267806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:38.298285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:38.299617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:38.302003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:38.302003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:38.308373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:38.309344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:38.339583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f9057781-ab4f-4fd3-99fc-262e39b61b93 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.296670 Sep 05 14:34:38.343746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 30/64] 10.222.0.15 () {58 vars in 1188 bytes} [Mon Sep 5 14:34:38 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:38.350600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:38.360493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:38.381594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:38.383080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:38.383670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:38.386519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:38.387418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:38.389598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:38.584405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:38.605209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:38.607287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:38.622641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-880fcc8a-26e4-4e22-a6a4-735b759f6057 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1333 microversion: 2.20 time: 0.351357 Sep 05 14:34:38.623347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 35/65] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1333 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:38.643878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6d16c55b-189e-476d-8b65-ed3bc9ab5671 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] Calling method '.version_select at 0x7fb19185d280>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:38.860153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:38.873241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f1d885fb-e19f-435e-97ba-40f5d1087dac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1279 microversion: 2.1 time: 0.527303 Sep 05 14:34:38.873839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 31/66] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:38 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1279 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:38.876623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6d16c55b-189e-476d-8b65-ed3bc9ab5671 tempest-VolumesTestJSON-1689831741 tempest-VolumesTestJSON-1689831741-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.251361 Sep 05 14:34:38.877791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 36/67] 10.222.0.15 () {58 vars in 1155 bytes} [Mon Sep 5 14:34:38 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:39.063347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:39.072639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:39.092887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.093394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.093834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.103096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.103778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.104237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.277963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:39.284203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:39.302652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.303346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.303869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.304865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.305580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.306221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.313032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:39.357293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f5e9dc7e-b5e9-46a9-ae70-97c6ee5e6f47 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1272 microversion: 2.1 time: 0.298273 Sep 05 14:34:39.361303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 37/68] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:39 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1272 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:39.660017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:39.660714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:39.677182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.678611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.680382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.681348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.685649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.686266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.703429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:39.715469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9a6105b3-b2ed-442d-8ff1-38f7b0ba8a35 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1299 microversion: 2.1 time: 0.441782 Sep 05 14:34:39.716193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 32/69] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:39 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1299 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:39.912809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:39.912809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:39.930521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.935867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.935867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.935867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:39.936707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:39.941679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:39.961706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:39.982155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:39.983560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:39.985086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0207a46b-94a8-4992-8421-08dd575ccaee tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1339 microversion: 2.20 time: 0.336237 Sep 05 14:34:39.986159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 38/70] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1339 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:40.394425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:40.395100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:40.414252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:40.414632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:40.415142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:40.415888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:40.416473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:40.416908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:40.583046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:40.598209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-36481661-4a24-4f62-b49a-2eea31b67eaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1279 microversion: 2.1 time: 0.690256 Sep 05 14:34:40.598855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 33/71] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:39 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1279 bytes in 692 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:40.743508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:40.744427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:40.752408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:40.753150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:40.753908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:40.754871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:40.755505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:40.756076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:41.007658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:41.018882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-528533d6-a7b2-49dc-a768-8b2ed1eb7146 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1299 microversion: 2.1 time: 0.280088 Sep 05 14:34:41.020124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 34/72] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:40 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1299 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:41.025511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:41.026428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:41.033640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:41.034650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:41.035295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:41.037058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:41.037745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:41.038705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:41.185452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:41.208808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:41.216609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:41.225138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:41.226161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c315accc-782c-4f50-acc8-7e61065f4a35 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1339 microversion: 2.20 time: 0.204881 Sep 05 14:34:41.226720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 35/73] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1339 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:41.248425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d24ad7cc-466b-4e8c-a829-d1799c58e55c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.858357 Sep 05 14:34:41.248650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 39/74] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:40 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 860 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:41.631028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:41.631777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:41.642075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:41.643950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:41.644565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:41.646074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:41.646776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:41.647481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.054303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:42.054965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:42.065341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=8 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:42.087067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:42.087557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:42.087987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.099740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:42.101742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:42.114358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.545619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:42.562353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-01eec13f-4ef3-4ee5-b784-71a902947c78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.942256 Sep 05 14:34:42.563381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 36/75] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:41 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:42.570340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:42.571938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:42.579418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:42.580109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:42.580690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.581790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:42.582366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:42.583565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.629739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=4 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:42.675213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:42.690998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7afb44c-96ba-4b86-9e6f-524b753af687 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.642541 Sep 05 14:34:42.715545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 40/76] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:42 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:42.721741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:42.722588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:42.726900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:42.730232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:42.730911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:42.735757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.735757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:42.735757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:42.735757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:42.743670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:42.758776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:42.758776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2f1c01a-2955-497f-90cd-e0762d458974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1339 microversion: 2.20 time: 0.190803 Sep 05 14:34:42.760073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 37/77] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1339 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:43.422499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:43.438350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6d978bad-5f2e-4dd4-a08c-288e182012b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.721448 Sep 05 14:34:43.450820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 41/78] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:42 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 723 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:43.593241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:43.593241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:43.593241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:43.605417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:43.605911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:43.606382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:43.607052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:43.607496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:43.607908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:43.723390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:43.724046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:43.735588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:43.736085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:43.737147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:43.737895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:43.738339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:43.741531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:44.317855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:44.332091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-589c55a3-ef46-4ab5-af7b-2dba7a9e8174 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.749222 Sep 05 14:34:44.335628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 38/79] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:43 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:44.362734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:44.367049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:44.376123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:44.378959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:44.378959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:44.378959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:44.378959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:44.380840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:44.920762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:44.942920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1ebb174a-0042-4a32-99a2-b9b38dc1a7c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 1.211768 Sep 05 14:34:44.942920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 42/80] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:43 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 1223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:44.951197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=24 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:44.955245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:44.955887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:44.958546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:44.970141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:44.970724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:44.972089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:44.973042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:44.973774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:44.975679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:44.976546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:44.976995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:44.977606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-081efa45-8857-45db-ae65-8a9ed33873fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.640456 Sep 05 14:34:44.978767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 39/81] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:45.095533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=28 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:45.486615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "90621a62-caad-4a01-97cf-67f270d9de0b", "tag": "a0de9f2d-b0aa-4759-9953-d5d2bf8eb09c"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:45.515030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:45.515608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:45.516008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:45.545268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Creating event network-changed:a0de9f2d-b0aa-4759-9953-d5d2bf8eb09c for instance 90621a62-caad-4a01-97cf-67f270d9de0b on hv-cinder-84290 Sep 05 14:34:45.546001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 14:34:45.546539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4bca6aae-e8c5-4a0c-9d54-be849aab1fda req-e8478678-99f8-43ce-a90b-546c1249426e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 14:34:45.547720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:45.548390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:45.549743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:45.550773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:45.551469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:45.552100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:45.561567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.compute.rpcapi [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 14:34:45.568008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] Releasing lock "compute-rpcapi-router" {{(pid=127609) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 14:34:45.592309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1be5dd5d-c7de-4797-a68a-b2a1cb8f46e4 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.238901 Sep 05 14:34:45.593213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 40/82] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:34:45.603361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:45.604015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:45.610893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:45.612418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:45.613052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:45.614005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:45.614956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:45.615566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:45.929064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:45.933591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:45.947873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-83494cea-8553-4591-882f-1ca0a85dce23 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 1.005609 Sep 05 14:34:45.954044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 43/83] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:44 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 1010 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:46.065662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffb7ea1-4123-4566-abf2-23b62cc9a169", "tag": "75fd2d9a-1850-4c10-8651-4ce1cf876222"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:46.099931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.100421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.100849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.139602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Creating event network-changed:75fd2d9a-1850-4c10-8651-4ce1cf876222 for instance dffb7ea1-4123-4566-abf2-23b62cc9a169 on hv-cinder-84290 Sep 05 14:34:46.140286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Sep 05 14:34:46.140883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-48e33044-1a2c-4502-9421-bc418b4f6928 req-8d7d4858-4c27-4187-8467-ce87d77e962e service nova] Acquired lock "compute-rpcapi-router" {{(pid=127608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Sep 05 14:34:46.142049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.142758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.143670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.145178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.145820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.146771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.150976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:46.160750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.compute.rpcapi [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 05 14:34:46.162358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] Releasing lock "compute-rpcapi-router" {{(pid=127608) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Sep 05 14:34:46.162990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-29684353-8440-454f-9530-0421e21d0808 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.567996 Sep 05 14:34:46.164290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 41/84] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:45 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:46.184928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:46.185808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:46.188754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ada96b3-4172-4af3-8d5e-c7fe4446a851 None None] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.234380 Sep 05 14:34:46.189130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 44/85] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:34:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:46.200206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.202378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.204053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.205397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:46.206250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.213438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:46.213751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.213751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.215514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.216206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.216877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.217882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:46.218643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:46.219284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:46.518640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:46.542172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:46.545839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:46.547911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-956f06e3-0058-46c0-9903-fade3d828f34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.356933 Sep 05 14:34:46.550381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 45/86] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:46.790423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:46.802718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a39d508c-67eb-4723-81c0-dc35d1e972ee tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.637157 Sep 05 14:34:46.805401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 42/87] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:46 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:47.007889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:47.011868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:47.034378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:47.042497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:47.044267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:47.046511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:47.047639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:47.049778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:47.193088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:47.198295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:47.239637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:47.241455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:47.242374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:47.243272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:47.244970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:47.245733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:47.366959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:47.382056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1eade70b-1c6d-4a0e-82f6-e03ef5f0c3b4 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.397716 Sep 05 14:34:47.382896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 46/88] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:46 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:47.577093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:47.577688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:47.601345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:47.602198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:47.602779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:47.603663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:47.604260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:47.604825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:48.208694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:48.214364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:48.225009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:48.243307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8adc84ea-cd21-47f0-84b1-568a9ca95b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 1.059012 Sep 05 14:34:48.243457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:48.244911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 43/89] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:47 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 1062 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:48.257995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:48.259828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-f86ebed1-86bf-4a2e-85d4-543c3195322f req-c4b530fb-3ddb-462f-85f8-cf20b39bdeb9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a94776-abef-42ea-a633-c70dedfdacab", "tag": "c898cf19-a336-4343-9ccc-5bdb6f2eb060"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:48.264220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8a87aa88-6388-4956-8958-2d8f4a5a74f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.690715 Sep 05 14:34:48.271599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 47/90] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:48.293624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f86ebed1-86bf-4a2e-85d4-543c3195322f req-c4b530fb-3ddb-462f-85f8-cf20b39bdeb9 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:48.294251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f86ebed1-86bf-4a2e-85d4-543c3195322f req-c4b530fb-3ddb-462f-85f8-cf20b39bdeb9 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.018s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:48.294827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f86ebed1-86bf-4a2e-85d4-543c3195322f req-c4b530fb-3ddb-462f-85f8-cf20b39bdeb9 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:48.300976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:48.308999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:48.340751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-f86ebed1-86bf-4a2e-85d4-543c3195322f req-c4b530fb-3ddb-462f-85f8-cf20b39bdeb9 service nova] Creating event network-changed:c898cf19-a336-4343-9ccc-5bdb6f2eb060 for instance 57a94776-abef-42ea-a633-c70dedfdacab on hv-cinder-84290 Sep 05 14:34:48.341196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:48.341995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:48.347038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:48.347919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:48.348504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:48.350394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:48.354674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-f86ebed1-86bf-4a2e-85d4-543c3195322f req-c4b530fb-3ddb-462f-85f8-cf20b39bdeb9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105522 Sep 05 14:34:48.360508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 44/91] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:48.398716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3060a33f-220b-4ef5-a330-ffca8c4c871e", "tag": "69006b7a-d9b5-4c63-991e-0ee9da068a63"}, {"name": "network-changed", "server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:34:48.425514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:48.429728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:48.433047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:48.465442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] Creating event network-changed:69006b7a-d9b5-4c63-991e-0ee9da068a63 for instance 3060a33f-220b-4ef5-a330-ffca8c4c871e on hv-cinder-84290 Sep 05 14:34:48.468128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] Creating event network-changed:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:34:48.493498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-2afc628d-1329-4040-91f2-ca2cf7ac3bf8 req-0e7b46e0-36f1-462f-b9c6-4345a93bab4a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.105604 Sep 05 14:34:48.500609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 45/92] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:34:48 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:34:48.511782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:48.518337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:48.528794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:48.530579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:48.536144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:48.536730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:48.537577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:48.538151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:48.538816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:49.159872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:49.171672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cdde062a-1129-4be5-82ab-5cfbe6a25c71 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.894860 Sep 05 14:34:49.172259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 48/93] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:48 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:49.209452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:49.218049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1aad672b-2f55-42a5-8784-6a56117feb20 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.710354 Sep 05 14:34:49.218648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 46/94] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:48 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:49.267874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:49.268599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:49.278147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:49.278702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:49.288328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:49.289155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:49.289643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:49.290081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:49.311965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:49.312563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:49.325923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:49.327656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:49.328316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:49.332685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:49.333506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:49.336228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:49.801741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:49.812151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f85f8a72-292b-4bf1-a427-140848ed8c4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.548814 Sep 05 14:34:49.822376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 49/95] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:49 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:49.901741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:49.916094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:49.917685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:49.918918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fcc0b6bb-7bec-471a-89f4-2d74f24aa30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.610949 Sep 05 14:34:49.942932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 47/96] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 634 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:34:50.201555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:50.202427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:50.213965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.218113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.218841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.221597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.222428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.223177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.241657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:50.242329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:50.251190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.256749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.257326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.258392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.259296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.260199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.808938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:50.809697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:50.810497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4620d123-55c4-4c1d-ae0a-3bcb97f19228 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.555921 Sep 05 14:34:50.810497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 48/97] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:50 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:50.810760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-688d0500-88ff-4a85-9443-0ff6c09a684f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.602160 Sep 05 14:34:50.816963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 50/98] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:50 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:50.844532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:50.845153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:50.852593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.853349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.854334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.855263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.855918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.856693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.950655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:50.951311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:50.957386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.959586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.959586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:50.959586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:50.959586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:50.960022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:51.341089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:51.351899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-67fcbeac-d9d1-4471-bb81-74bcba107e35 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.513707 Sep 05 14:34:51.356417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 49/99] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:50 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:51.429530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:51.438347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:51.440382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:51.441562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66c0992d-0d0d-48f7-956c-dab01c54f642 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.494760 Sep 05 14:34:51.442128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 51/100] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:51.825441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:51.826044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:51.828209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:51.837819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:51.837960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:51.837960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:51.837960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:51.837960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:51.838278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:51.838644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:51.838740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:51.838859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:51.838859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:51.838859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:51.838859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:51.839148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:52.029616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:52.032935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:52.041853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-98a15c50-9a87-4153-9864-521ebb686a77 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.217645 Sep 05 14:34:52.041853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 50/101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:51 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:52.042087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-569b469e-7460-4961-9cf0-1fd27d48afb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.217643 Sep 05 14:34:52.042087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 52/102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:51 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:52.378884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:52.380172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:52.386377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:52.386891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:52.387324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:52.388002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:52.388611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:52.389020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:52.471478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:52.473516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:52.483323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:52.483323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:52.489899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:52.490706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:52.491276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:52.491773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:52.560117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:52.568609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9fc4eaa2-28ed-406d-90d5-2d7d64a9c22d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.193755 Sep 05 14:34:52.569227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 51/103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:52 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:52.659600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:52.667886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:52.669602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:52.670713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0322ddf6-ceec-4fc2-b6f6-56fe20bab7ba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.203902 Sep 05 14:34:52.671298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 53/104] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:53.075629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:53.077086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:53.079134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:53.081384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:53.088864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.089063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.089440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.089798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.090336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.090524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.091257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.091566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.091925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.092360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.092523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.093079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.301500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:53.309743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:53.310511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2cd4c17c-b5e3-4b4b-b0c3-e54917a22e82 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.248466 Sep 05 14:34:53.311299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 52/105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:53 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:53.322955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b42b6b4c-9dfa-467c-92cb-3e4882d171b0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.257413 Sep 05 14:34:53.322955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 54/106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:53 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:53.605114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:53.605114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:53.605114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.605114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.605473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.605473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.605473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.605473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.697481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:53.698219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:53.709041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.709800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.710305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.711249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:53.712926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:53.714032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:53.839793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:53.852380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f4f0e6e-4bc2-4574-8ccf-558c9458a2e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.263999 Sep 05 14:34:53.853004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 55/107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:53 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:53.916398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:53.925153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:53.926810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:53.928047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-92e94f66-d18f-427b-8a60-9c70d7af0f8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.234750 Sep 05 14:34:53.928763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 53/108] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:54.333519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:54.334358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:54.345908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:54.346568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:54.349709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.350208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.350646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.351540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.351816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.356562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.358771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.362006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.362006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.362006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.362006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.362420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.612948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:54.632475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53acb857-80ca-4cb8-9fc4-b419b4416d73 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.291851 Sep 05 14:34:54.646839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 54/109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:54 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:54.647153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:54.649789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e9df5644-70a6-4f85-9aaf-e7705f4f2f78 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.320266 Sep 05 14:34:54.650361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 56/110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:54 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:54.876957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:54.877599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:54.883582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.884074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.884514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.885206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.885659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.886254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.953608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:54.954380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:54.960897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.961442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.961942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:54.962692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:54.963234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:54.964004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:55.082745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:55.094857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e12708f4-115e-47fb-85f8-01e9fc7edc78 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.221687 Sep 05 14:34:55.096117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 55/111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:54 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:55.142808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:55.152405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:55.153892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:55.155062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e6729a1-970d-486b-ad02-c4fade5e9ec5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.205402 Sep 05 14:34:55.155615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 57/112] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:34:55.659178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:55.659848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:55.662016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:55.668479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:55.669046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:55.669540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:55.670469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:55.671051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:55.671535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:55.672549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:55.673172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:55.682033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:55.682699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:55.683299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:55.684299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:55.684895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:55.686006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:55.864765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:55.873321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-daf523ce-97a7-46ab-802e-d9c5b3645dbc tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.218036 Sep 05 14:34:55.873939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 56/113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:55 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:55.883928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:55.892092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3776063-5e24-4c67-aa32-244eeee34c0c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.223804 Sep 05 14:34:55.893251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 58/114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:55 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:56.118372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:56.119015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:56.124995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.125480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.125940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.127308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.127598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.128021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.180998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:56.181520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:56.183540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:56.188258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.188741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.189173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.190484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.190970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.191418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.307373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:56.315977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-393f0e07-60c5-478b-80fb-1419fadd0820 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.201353 Sep 05 14:34:56.316553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:56 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:56.346293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:56.354385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:56.355830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:56.356929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-91775edc-310c-46da-8c2b-18cba034adcd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.179978 Sep 05 14:34:56.357490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 59/116] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:34:56.900338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:56.900894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:56.909778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.910540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.911005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.911740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.912226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.912678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.915872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:56.916471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:56.922813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.923320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.924324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:56.924998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:56.925442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:56.925855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:57.124912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:57.133422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-881579fb-c9aa-4847-8845-0ae47c0bad97 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.237195 Sep 05 14:34:57.133985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 58/117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:56 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:57.138973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:57.142404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:57.146839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0a45ffbd-d98b-4681-884a-c365749e87a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.234969 Sep 05 14:34:57.147400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 60/118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:56 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:57.339067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:57.339676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:57.346128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:57.346643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:57.347103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:57.347788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:57.348240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:57.348664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:57.381750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:57.382348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:57.388307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:57.388778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:57.389283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:57.389960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:57.390402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:57.390845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:57.577786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:57.596134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d624ac20-8431-40d1-b957-3b0ad84688b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.256976 Sep 05 14:34:57.596134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 59/119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:57 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:57.598930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:57.608698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:57.610280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:57.611341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd882c02-c9a0-4a1b-ab44-6cc25368c0b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.233585 Sep 05 14:34:57.617657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 61/120] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:34:58.155670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:58.156417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:58.169370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:58.170045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:58.175205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.176073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.176756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.178707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.179461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.180139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.183133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.184136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.184584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.185304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.187601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.189773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.462615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:58.471684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07e9d1e8-0ed0-4699-88d3-928ce6e16243 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.306395 Sep 05 14:34:58.472324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 62/121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:58 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:58.492015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:58.499845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-57f3b401-880a-4714-9808-680355938751 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.347965 Sep 05 14:34:58.500690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 60/122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:58 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:58.618372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:58.619014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:58.625417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.626434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.627776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.628969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.629571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.630140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.642658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:58.643458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:58.650987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.651671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.652284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.653139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:58.653744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:58.654326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:58.825342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:58.832874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cbd97bc6-89bf-4742-b3dc-b475c31e86f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.218877 Sep 05 14:34:58.833441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 63/123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:58 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:58.853323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:58.856790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:34:58.861802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:58.863285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:58.864395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c4de216f-7c31-40ad-b8cb-3e06c3e3ef4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.225699 Sep 05 14:34:58.864949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 61/124] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:34:59.496668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:59.497272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:59.504128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.504613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.505036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.505718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.506146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.506557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.523093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:59.523705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:59.529769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.530175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.530620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.531348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.531800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.532218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.727049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:59.735312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8e9c7763-d574-4f98-b600-99f184283536 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.242353 Sep 05 14:34:59.738722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 64/125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:59 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:34:59.738967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:34:59.751539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-14638ec2-3059-4893-8b22-c1d06034b791 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.226975 Sep 05 14:34:59.751539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 62/126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:59 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:34:59.856441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:59.856982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:59.863334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.867837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.867837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.867837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.867837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.868158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.892278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:34:59.894608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:34:59.901278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.901857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.902201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:34:59.907694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:34:59.907694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:34:59.907694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:00.040950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:00.049415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d6a0daaf-0df2-487a-97c7-b14bd1035274 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.196868 Sep 05 14:35:00.050019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 65/127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:34:59 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:00.123765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:00.134440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:00.135943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:00.137057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9d875c24-547e-449e-97e8-b8f105ad2de3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.249281 Sep 05 14:35:00.137782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 63/128] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:34:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:00.327032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-da48f3f0-f86f-42e5-9390-d37bd64ec89a req-0d963d77-2c89-4082-aac9-d00702611eab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90621a62-caad-4a01-97cf-67f270d9de0b", "name": "network-vif-plugged", "status": "completed", "tag": "a0de9f2d-b0aa-4759-9953-d5d2bf8eb09c"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:00.337492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-da48f3f0-f86f-42e5-9390-d37bd64ec89a req-0d963d77-2c89-4082-aac9-d00702611eab service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:00.337971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-da48f3f0-f86f-42e5-9390-d37bd64ec89a req-0d963d77-2c89-4082-aac9-d00702611eab service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:00.338396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-da48f3f0-f86f-42e5-9390-d37bd64ec89a req-0d963d77-2c89-4082-aac9-d00702611eab service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:00.350541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-da48f3f0-f86f-42e5-9390-d37bd64ec89a req-0d963d77-2c89-4082-aac9-d00702611eab service nova] Creating event network-vif-plugged:a0de9f2d-b0aa-4759-9953-d5d2bf8eb09c for instance 90621a62-caad-4a01-97cf-67f270d9de0b on hv-cinder-84290 Sep 05 14:35:00.356886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-da48f3f0-f86f-42e5-9390-d37bd64ec89a req-0d963d77-2c89-4082-aac9-d00702611eab service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094786 Sep 05 14:35:00.357586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 66/129] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:00.758104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:00.758716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:00.764609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:00.765093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:00.765530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:00.766274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:00.766729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:00.767200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:00.771295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:00.773234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:00.782105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:00.782105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:00.782105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:00.782105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:00.782722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:00.783216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:00.972085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:00.979090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:00.979769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-66af6230-2e59-4296-b8be-5490ca083f40 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.225528 Sep 05 14:35:00.980345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 64/130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:00 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:00.987491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6672665b-a585-4add-b2f3-184476658c84 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.220532 Sep 05 14:35:00.993074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 67/131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:00 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:01.072174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:01.073220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:01.079193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:01.079678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:01.080200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:01.080883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:01.081329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:01.081749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:01.164308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:01.164904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:01.170846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:01.171314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:01.171750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:01.172446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:01.172895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:01.173304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:01.233872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:01.249823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bf999a81-3a34-4060-b713-2c8207b3e1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.181289 Sep 05 14:35:01.250581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 65/132] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:01 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:01.328597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:01.348309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:01.350131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:01.351461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ef2ecf2-9648-4e5f-b266-9c4fc0bf8da8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.191193 Sep 05 14:35:01.352022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 68/133] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:02.002764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:02.003401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:02.009485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.009971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.010475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.011325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.011784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.012207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.014959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:02.021316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:02.022206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.022749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.023216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.024064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.024522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.024948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.213133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:02.217682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:02.222307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-566419de-7dc6-46ca-9b32-a8e92a84a99b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.223697 Sep 05 14:35:02.226803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-db830189-2eda-41de-987d-65a1e03abb75 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.215846 Sep 05 14:35:02.227506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 69/134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:02 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:02.230862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 66/135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:01 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:02.277612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:02.278666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:02.284594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.285319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.285779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.286470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.287028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.287457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.376045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:02.377232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:02.386275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.387068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.387506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.388207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:02.388817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:02.389245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:02.568869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:02.577118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ca064b8b-1c5a-4d2e-bb08-17fd9a18ee4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.303534 Sep 05 14:35:02.577861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 70/136] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:02 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:02.633200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:02.642283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:02.644020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:02.645116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b5eabc38-f0b9-41b5-9965-b4d8535e3349 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.272911 Sep 05 14:35:02.645670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 67/137] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:03.252511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:03.253128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:03.253367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:03.254569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:03.260094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.260563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.260686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.260950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.261050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.261378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.261807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.262059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.262259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.262506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.262673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.262985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.641144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:03.648746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:03.650056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57aadf62-40ac-4e7a-8ae1-d5a928e41143 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.402415 Sep 05 14:35:03.650618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 71/138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:03 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:03.655704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:03.656596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:03.662928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cac2364c-1cde-4173-853a-b9375e4291d7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.413661 Sep 05 14:35:03.663603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.664262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 68/139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:03 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:03.671809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:03.672382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:03.672487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.679151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.679151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.679151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.679516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.679516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.679701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.680305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:03.680753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:03.681171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.681895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:03.921043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:03.929666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:03.930089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:03.931569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:03.933085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c227374-482b-4b8a-94af-f9f36c6b668b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.264801 Sep 05 14:35:03.933803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 69/140] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:03.944166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a0650f0e-7a00-447e-90b4-6dfbadba5f3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.292270 Sep 05 14:35:03.945164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 72/141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:03 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:04.673076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:04.673669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:04.679646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.680114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.680538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.681207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.681649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.682062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.689289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:04.689897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:04.695933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.696412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.696846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.697529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.697981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.698436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.884028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:04.887338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:04.891699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18b81fd9-c288-40db-bb8e-537700b7e147 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.222517 Sep 05 14:35:04.892960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 70/142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:04 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:04.895730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90a5c4fc-9984-4e59-a8e1-e8cd9e62c037 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.210245 Sep 05 14:35:04.896377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 73/143] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:04 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:04.959102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:04.960043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:04.966489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.967093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.967582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.967746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:04.968541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.968652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:04.969080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.969566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.975374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.975870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.976306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:04.977001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:04.977484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:04.977908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:05.175870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:05.178307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:05.184245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:05.185851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:05.187195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2bede5b3-6be4-4f1c-b71d-01748d6430ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.223774 Sep 05 14:35:05.187337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b2a73f39-195e-4b00-8703-f6ee95bb777f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.233269 Sep 05 14:35:05.188109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 74/144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:04 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:05.188191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 71/145] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:05.915088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:05.915688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:05.917325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:05.917956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:05.921751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:05.922202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:05.922657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:05.923455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:05.924014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:05.924144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:05.924498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:05.924601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:05.924933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:05.925615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:05.926068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:05.926490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:06.123884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:06.127970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:06.132782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49b07e26-6f4e-44a2-8128-b4671a8e5e2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.219259 Sep 05 14:35:06.133361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 72/146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:05 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:06.135863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-152cbc17-6998-48a0-a1a6-90c3c66cc4e9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.224682 Sep 05 14:35:06.136413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 75/147] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:05 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:06.215995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:06.218065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:06.221315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:06.221942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:06.223533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:06.223835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:06.224893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:06.225013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:06.225388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:06.225806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:06.228016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:06.228496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:06.228917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:06.229699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:06.230140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:06.230552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:06.441268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:06.445499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:06.456644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-41d15efc-7494-4825-80e3-1ebdb7846d19 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.244649 Sep 05 14:35:06.457680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 73/148] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:06 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:06.458691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:06.460257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:06.461408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-34d05a7e-abd2-4189-9413-43ffbe51a32e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.243914 Sep 05 14:35:06.461984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 76/149] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:07.158321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:07.159596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:07.160184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:07.160793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:07.166192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.167613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.167933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.168644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.169170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.169861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.170213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.170364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.171233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.171486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.171949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.172374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.377658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:07.380373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:07.386161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-625cc3cc-5df0-4b9d-a984-a5f06002c2f5 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.230351 Sep 05 14:35:07.386975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 77/150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:07 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:07.388430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-15d50650-20d9-4477-8c73-2fdb9318ecc4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.235306 Sep 05 14:35:07.397300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 74/151] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:07 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:07.401622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-b7ecf4e0-f788-4a0e-905e-20709d34b4d4 req-99108d14-4dc7-4ede-ab75-093c57413aee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3060a33f-220b-4ef5-a330-ffca8c4c871e", "name": "network-vif-plugged", "status": "completed", "tag": "69006b7a-d9b5-4c63-991e-0ee9da068a63"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:07.412170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-b7ecf4e0-f788-4a0e-905e-20709d34b4d4 req-99108d14-4dc7-4ede-ab75-093c57413aee service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.412875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-b7ecf4e0-f788-4a0e-905e-20709d34b4d4 req-99108d14-4dc7-4ede-ab75-093c57413aee service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.413336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-b7ecf4e0-f788-4a0e-905e-20709d34b4d4 req-99108d14-4dc7-4ede-ab75-093c57413aee service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.417211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:07.425136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-b7ecf4e0-f788-4a0e-905e-20709d34b4d4 req-99108d14-4dc7-4ede-ab75-093c57413aee service nova] Creating event network-vif-plugged:69006b7a-d9b5-4c63-991e-0ee9da068a63 for instance 3060a33f-220b-4ef5-a330-ffca8c4c871e on hv-cinder-84290 Sep 05 14:35:07.430097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-b7ecf4e0-f788-4a0e-905e-20709d34b4d4 req-99108d14-4dc7-4ede-ab75-093c57413aee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041813 Sep 05 14:35:07.430685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 78/152] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:07.478716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:07.479458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:07.485438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.486436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.486884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.487287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:07.487571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.487995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:07.488088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.488430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.494109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.494585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.495058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.495735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:07.496179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:07.496590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:07.686173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:07.700981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7b01bfd5-8a62-4fbc-a1de-a6de6d1c2322 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.225870 Sep 05 14:35:07.709208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 75/153] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:07 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:07.729792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:07.738367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:07.739853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:07.740958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee6556ea-bd20-451c-95c3-9e88e09ad85f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.258483 Sep 05 14:35:07.741511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 79/154] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:08.409872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:08.410542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:08.411652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:08.412291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:08.416614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.417099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.417539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.418219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.418625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.418723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.419114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.419227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.419633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.420261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.420688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.421106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.613337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:08.620997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:08.622177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0ecfb739-545e-424d-941a-77d18971bfad tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.216476 Sep 05 14:35:08.623371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 76/155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:08 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:08.630467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ca82b86-595d-4c5d-9c33-03ea8ba6201d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.222727 Sep 05 14:35:08.631057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 80/156] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:08 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:08.723431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:08.724045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:08.730184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.731752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.731752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.731957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.732349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.732764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.765527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:08.769469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:08.772755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.773313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.773745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.774436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:08.774947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:08.775370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:08.910366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:08.917916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7223053-191e-4db0-8196-e23913a3b6f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.198370 Sep 05 14:35:08.918598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 77/157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:08 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:08.940028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:08.947989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:08.949429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:08.950521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a8d478f-c39d-4c4b-b76c-b09947eb783e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.188916 Sep 05 14:35:08.951121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 81/158] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:09.445449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-0a430efa-df7a-4680-8ce4-da4010542f40 req-7bb7cc85-7b7e-48a2-8ced-e3d8d0aa2f09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffb7ea1-4123-4566-abf2-23b62cc9a169", "name": "network-vif-plugged", "status": "completed", "tag": "75fd2d9a-1850-4c10-8651-4ce1cf876222"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:09.456837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0a430efa-df7a-4680-8ce4-da4010542f40 req-7bb7cc85-7b7e-48a2-8ced-e3d8d0aa2f09 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.456837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0a430efa-df7a-4680-8ce4-da4010542f40 req-7bb7cc85-7b7e-48a2-8ced-e3d8d0aa2f09 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.456837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0a430efa-df7a-4680-8ce4-da4010542f40 req-7bb7cc85-7b7e-48a2-8ced-e3d8d0aa2f09 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.466283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-0a430efa-df7a-4680-8ce4-da4010542f40 req-7bb7cc85-7b7e-48a2-8ced-e3d8d0aa2f09 service nova] Creating event network-vif-plugged:75fd2d9a-1850-4c10-8651-4ce1cf876222 for instance dffb7ea1-4123-4566-abf2-23b62cc9a169 on hv-cinder-84290 Sep 05 14:35:09.471693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-0a430efa-df7a-4680-8ce4-da4010542f40 req-7bb7cc85-7b7e-48a2-8ced-e3d8d0aa2f09 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029937 Sep 05 14:35:09.472257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 78/159] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:09.647835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:09.648443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:09.654472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.656178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.656178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.656178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.656908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.657083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.664201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:09.664882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:09.678462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.679012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.679582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.680295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.680810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.681174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.688622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:09.854249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:09.858139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:09.862296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-405ff1e0-c051-476b-8109-e5009dbf10f3 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.218262 Sep 05 14:35:09.862988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 82/160] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:09 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:09.865685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-05301b6c-2a02-43a5-ba26-335e3d15360f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.207485 Sep 05 14:35:09.866240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 79/161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:09 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:09.940565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:09.941084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:09.946961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.947428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.947850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.948517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.948957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.949371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.975957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:09.976557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:09.982711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.983230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.983661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:09.984341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:09.984790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:09.985207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:10.127391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:10.135025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5e9b7c18-5911-4fc9-9a98-514f4aa788a1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.198287 Sep 05 14:35:10.150548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 83/162] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:09 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:10.156895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:10.164983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:10.166401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:10.167554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b3b8432a-1e3a-4213-a531-aef7e05df6d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.195450 Sep 05 14:35:10.168107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 80/163] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:10.884866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:10.885483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:10.888844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:10.889467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:10.891428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:10.891908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:10.892549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:10.893277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:10.893730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:10.894153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:10.895532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:10.896003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:10.896433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:10.897104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:10.897547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:10.898073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:11.072952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:11.081043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7c09146e-5673-4677-aba8-b80150abe8c0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.200056 Sep 05 14:35:11.081609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 84/164] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:10 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:11.087588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:11.096291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fcdfde22-eca8-4189-a33b-806d49646eeb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.211184 Sep 05 14:35:11.096865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 81/165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:10 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:11.158681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:11.159321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:11.165193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:11.165672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:11.166103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:11.166802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:11.167260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:11.167682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:11.192244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:11.192933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:11.199506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:11.200053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:11.200549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:11.201315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:11.201823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:11.202301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:11.350199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:11.357978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3da6e319-a076-43c6-8a55-8ad110cc8017 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.203695 Sep 05 14:35:11.358542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 85/166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:11 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:11.371461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:11.379818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:11.381248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:11.382401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7d2a5b7-9630-4973-a826-7dedae33565d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.194120 Sep 05 14:35:11.382985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 82/167] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:12.107014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:12.107014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:12.110136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.110617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.111644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.112328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.112777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.114540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.119783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:12.120631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:12.127498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.127999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.128494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.129258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.129821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.130839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.310029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:12.317627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eb6a838e-610c-4ad7-9ffe-072c3413b953 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.217720 Sep 05 14:35:12.327727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:12.328326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 86/168] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:12 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:12.328418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-152d5e17-1d82-4100-bce7-344b18fdb3b7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.210906 Sep 05 14:35:12.328418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 83/169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:12 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:12.381264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:12.381798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:12.387701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.388175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.388596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.389266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.389710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.390120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.407052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:12.408182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:12.414034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.414509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.415066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.415744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:12.416216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:12.416631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:12.590429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:12.593776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:12.599395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-74c9e155-d83e-48d4-b9ce-f0af730e8369 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.222044 Sep 05 14:35:12.599998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 87/170] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:12 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:12.618169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:12.618169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:12.618169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-104d95c8-6268-42f0-8bce-2a0e7d6a02bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.201419 Sep 05 14:35:12.619237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 84/171] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:13.341639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:13.342276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:13.348875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.349289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.349705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:13.350096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.350309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:13.350408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.350834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.351261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.356118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.356592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.357017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.357697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.358140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.358552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.544143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:13.551100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:13.552550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-86216c92-b243-46d1-a62d-01b98a9e597f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.214985 Sep 05 14:35:13.553145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 88/172] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:13 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:13.558689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0cc06676-9bf4-4411-aa6b-2b6453e2e5a3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.213314 Sep 05 14:35:13.559271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 85/173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:13 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:13.631041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:13.631574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:13.632836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:13.633434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:13.637470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.637949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.638379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.639084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.639872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.640297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.640408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.640823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.641258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.642176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:13.642417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:13.642867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:13.969708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:13.977742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-34954458-d3c7-4c0f-a738-2a7b4b76f720 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.351231 Sep 05 14:35:13.978314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 89/174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:13 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:13.981512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:13.989751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:13.991292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:13.992495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-48479a4b-dcae-4cfd-af3d-ddc547320a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.363332 Sep 05 14:35:13.993118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 86/175] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:14.574760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:14.575339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:14.577499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:14.581528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:14.582097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:14.582291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:14.582580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:14.583040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:14.583710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:14.584150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:14.584561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:14.588104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:14.594374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:14.594374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:14.594374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:14.594374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:14.594747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:14.777220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:14.780493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:14.785421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf9ced98-5e31-43f3-99c7-11df13aa1bd9 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.214484 Sep 05 14:35:14.785980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 90/176] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:14 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:14.788561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f550578c-90df-4c0d-8702-d99f5bf098de tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.210814 Sep 05 14:35:14.789118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 87/177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:14 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:14.999968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:15.000590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:15.007123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.010648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.010648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.010648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.010648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.011044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.021191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:15.021796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:15.027706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.028180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.028612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.029361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.029829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.030229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.200312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:15.206923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:15.207934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6fec584-59ad-4c89-be25-eebfc6e41389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.211792 Sep 05 14:35:15.208497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 91/178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:14 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:15.215420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:15.216851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:15.217939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55759d91-ddfe-41b2-97cb-053b09716da9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.200662 Sep 05 14:35:15.218484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 88/179] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:15.808686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:15.809283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:15.810580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:15.811214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:15.815466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.816023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.816520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.817146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.817353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.817622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.817871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.818052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.818310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:15.818725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:15.819199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:15.819617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:16.008563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:16.018139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09740a45-aadf-4871-98da-d81c539ba516 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.211085 Sep 05 14:35:16.018810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 89/180] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:15 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:16.020240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:16.027996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a433d8f2-bbd1-4676-93c7-5ea39f7c36bf tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.223431 Sep 05 14:35:16.028554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 92/181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:15 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:16.229897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:16.230592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:16.237499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:16.238113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:16.238547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:16.242929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:16.242929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:16.242929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:16.243266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:16.243266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:16.248772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:16.249252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:16.249678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:16.250542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:16.251024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:16.251446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:16.543659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:16.577760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:16.587077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-84226482-c3f8-4bb3-a22a-fb9e7f4baece tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.358025 Sep 05 14:35:16.587077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 90/182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:16 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:16.593485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:16.595137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:16.596710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cd77811e-aa0f-4191-9f40-a84947d757a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.358527 Sep 05 14:35:16.597255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 93/183] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:16.810760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-4e572a9f-73b6-47a9-b490-ee9e1122d2b9 req-43763fe3-8592-40d6-99f6-dfcad46e8bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a94776-abef-42ea-a633-c70dedfdacab", "name": "network-vif-plugged", "status": "completed", "tag": "c898cf19-a336-4343-9ccc-5bdb6f2eb060"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:16.820663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4e572a9f-73b6-47a9-b490-ee9e1122d2b9 req-43763fe3-8592-40d6-99f6-dfcad46e8bb0 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:16.821126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4e572a9f-73b6-47a9-b490-ee9e1122d2b9 req-43763fe3-8592-40d6-99f6-dfcad46e8bb0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:16.821542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4e572a9f-73b6-47a9-b490-ee9e1122d2b9 req-43763fe3-8592-40d6-99f6-dfcad46e8bb0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:16.832892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-4e572a9f-73b6-47a9-b490-ee9e1122d2b9 req-43763fe3-8592-40d6-99f6-dfcad46e8bb0 service nova] Creating event network-vif-plugged:c898cf19-a336-4343-9ccc-5bdb6f2eb060 for instance 57a94776-abef-42ea-a633-c70dedfdacab on hv-cinder-84290 Sep 05 14:35:16.837728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-4e572a9f-73b6-47a9-b490-ee9e1122d2b9 req-43763fe3-8592-40d6-99f6-dfcad46e8bb0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030726 Sep 05 14:35:16.838297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 91/184] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:17.040917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:17.041521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:17.047377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.053767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.053767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.053767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.053767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.054197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.054285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:17.054285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:17.058896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.059570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.060057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.060809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.061313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.061809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.310114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:17.316935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:17.318923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9836444-97fa-43a4-8196-0022f5f6059e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.281733 Sep 05 14:35:17.319640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 94/185] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:17 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:17.325746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4b4257fb-cb35-40a1-9edf-a4460f94bc2f tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.277861 Sep 05 14:35:17.326435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 92/186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:17 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:17.607411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:17.608021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:17.614208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.614688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.615155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.615840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.616288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.616706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.624781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:17.625431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:17.632330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.632877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.633619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.634134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:17.634760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:17.635197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:17.637084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:17.814157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:17.820824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:17.821606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f3d4a3e6-a13c-43c3-9db5-3159423f5bc7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.217982 Sep 05 14:35:17.822174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 95/187] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:17 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:17.828859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:17.830287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:17.831415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4eed51e9-abcc-4d20-88b2-eefbc21b23b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.210660 Sep 05 14:35:17.831957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 93/188] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:18.341780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:18.342415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:18.348182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:18.348452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.348850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:18.348981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.349350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.350028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.350479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.350931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.354599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.355100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.355525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.356196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.356638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.357054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.549976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:18.552921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d13c3ab-67a5-4cff-a311-8128fb30c5d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.215233 Sep 05 14:35:18.553307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:18.553670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 96/189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:18 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:18.561271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ca57f179-d06f-47aa-af64-a89ef70b0668 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.216835 Sep 05 14:35:18.561830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 94/190] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:18 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:18.844335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:18.844925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:18.850900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.851362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.851788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.852456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.852901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.853311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.856529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:18.857141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:18.864064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.864544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.864973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:18.865663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:18.866109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:18.866527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:19.055342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:19.060044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:19.063490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-adef916c-dcba-4faf-99c4-fdf45c514fa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.223011 Sep 05 14:35:19.064150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 97/191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:18 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:19.067973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:19.069494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:19.070670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c19a4817-9a1c-4048-a0af-c04555096c3f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.217964 Sep 05 14:35:19.071315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 95/192] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:19.575965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:19.576562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:19.582911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:19.583389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:19.583821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:19.584494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:19.584928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:19.585028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:19.585339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:19.585540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:19.588782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:19.592568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:19.593051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:19.593485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:19.594173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:19.594626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:19.595076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:19.614775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:19.791127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:19.791636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:19.793034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f5560e28-4a3d-4ace-8ff6-579df6f8a2e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.220864 Sep 05 14:35:19.793614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 98/193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:19 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:19.796601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5bab4843-43e9-42da-8e66-0d72858692a7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.215665 Sep 05 14:35:19.804279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 96/194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:19 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:20.085372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:20.085901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:20.092372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.093080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.093524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.094306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.094956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.095910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.096151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:20.096760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:20.102663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.103174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.103626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.104302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.104747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.105157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.288665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:20.296174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:20.297132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7b4d074e-3078-4e3e-a30f-a55b7827dd17 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.215271 Sep 05 14:35:20.297997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 99/195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:20 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:20.300895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:20.302330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:20.303470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0b1236e1-2239-4c5b-98d9-0e5043c66623 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.211760 Sep 05 14:35:20.304177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 97/196] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:20.816250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:20.816859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:20.820357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:20.821075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:20.823016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.823497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.823924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.824862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.825315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.825733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.829013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.830685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.830685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:20.831467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:20.832002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:20.832532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:21.020389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:21.023661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:21.031550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3b130324-6066-46e1-b7a3-5b5e15f07ed7 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.214849 Sep 05 14:35:21.032150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 98/197] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:20 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:21.034161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-03207ff0-68ac-416c-80cf-b1a04bfb7069 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.222250 Sep 05 14:35:21.034822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 100/198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:20 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:21.319297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:21.319895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:21.326008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:21.326490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:21.326954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:21.327642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:21.327746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:21.328089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:21.328343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:21.328514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:21.334212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:21.334720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:21.335186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:21.335869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:21.336347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:21.336765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:21.521660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:21.525693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:21.529367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-27577ac2-9d2e-4e81-984a-184ca53cb660 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.213983 Sep 05 14:35:21.529937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 99/199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:21 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:21.533780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:21.542108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:21.542108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd3ae769-282c-4bda-930b-1a30375bdf9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.212401 Sep 05 14:35:21.542108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 101/200] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:22.054972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:22.055634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:22.057277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:22.058054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:22.061832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.062340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.062905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.063522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.064082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.064179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.064441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.064615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.065060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.065760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.066381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.067209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.416734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:22.420056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:22.424706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7c34aa07-cfd5-4a1e-8286-2b9a99ab7bd2 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.373838 Sep 05 14:35:22.425274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 100/201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:22 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:22.428171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d88d397b-8094-408f-9f9e-4ec7293efa8a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.375096 Sep 05 14:35:22.428724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 102/202] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:22 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:22.551481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:22.552083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:22.557889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.559891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.560231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.564705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.564705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.564705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.565337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:22.566140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:22.572591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.573418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.573963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.574814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:22.575520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:22.576325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:22.772168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:22.774871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:22.780279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2f1d1711-390a-4dfb-b666-33c52cca2332 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.232576 Sep 05 14:35:22.780933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 101/203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:22 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:22.783732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:22.788320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:22.788320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2fa60e18-e2d6-4739-819a-a03275a470c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.225441 Sep 05 14:35:22.788320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 103/204] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:23.447821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:23.448503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:23.451135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:23.452815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:23.455570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.455893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.456385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.457237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.457685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.458255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.461425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.462227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.462842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.463769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.464476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.464899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.660960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:23.673691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:23.677510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2abe197a-d3a5-4f11-a1cd-37f0698e1f14 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.234233 Sep 05 14:35:23.678618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 102/205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:23 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:23.691045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4346e3c-3e98-439b-ae4c-b8d4dd817598 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.236768 Sep 05 14:35:23.691045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 104/206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:23 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:23.691225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-c2a6b612-a7ed-4497-880a-fd228560ce36 req-e790c38c-58ac-452a-85a9-ae78146cad34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "name": "network-vif-plugged", "status": "completed", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:23.693227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c2a6b612-a7ed-4497-880a-fd228560ce36 req-e790c38c-58ac-452a-85a9-ae78146cad34 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.693692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c2a6b612-a7ed-4497-880a-fd228560ce36 req-e790c38c-58ac-452a-85a9-ae78146cad34 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.694106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c2a6b612-a7ed-4497-880a-fd228560ce36 req-e790c38c-58ac-452a-85a9-ae78146cad34 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.706857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-c2a6b612-a7ed-4497-880a-fd228560ce36 req-e790c38c-58ac-452a-85a9-ae78146cad34 service nova] Creating event network-vif-plugged:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:35:23.718510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-c2a6b612-a7ed-4497-880a-fd228560ce36 req-e790c38c-58ac-452a-85a9-ae78146cad34 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038563 Sep 05 14:35:23.719225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 103/207] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:23.814471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:23.814471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:23.814782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:23.815523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:23.821691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.822164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.822910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.823517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.824126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.824545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.825527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.826021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.826452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:23.827346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:23.827798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:23.828270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:24.048256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:24.051301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:24.056147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-de980dfe-d4a1-4ef5-89de-b779ff5a09a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1321 microversion: 2.1 time: 0.247123 Sep 05 14:35:24.056717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 104/208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:23 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1321 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:24.059494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:24.061055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:24.062151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-81705dcb-61b6-405b-929a-e31e62975b4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.253889 Sep 05 14:35:24.062699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 105/209] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:24.704003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:24.705356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:24.710225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:24.713126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:24.713233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:24.713233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:24.713233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:24.713233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:24.713566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:24.713566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:24.717337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:24.717805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:24.718238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:24.719037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:24.719476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:24.719903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:24.909478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:24.913219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:24.918160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3813c5a0-fde5-497e-9099-95f064fc217a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.217993 Sep 05 14:35:24.918723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 105/210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:24 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:24.922334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-49596d05-d45e-4d32-8dde-51034e828f24 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.215322 Sep 05 14:35:24.923403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 106/211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:24 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:25.079459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:25.079561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:25.086476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.087085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.087234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:25.087653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.087772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:25.088516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.089298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.089792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.095835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.096572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.097170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.099290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.099752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.100176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.283294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:25.289959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:25.291015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9238e6cf-d11b-402a-a1ea-a36751f3ece9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1515 microversion: 2.1 time: 0.215980 Sep 05 14:35:25.291586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 106/212] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:25 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1515 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:25.298119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:25.300274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:25.301379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9595bc8b-d1ad-4a68-ad91-52ec559ce8d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.218003 Sep 05 14:35:25.301922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 107/213] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:25.320770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:25.323069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:25.328972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.329442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.329868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.330544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.331068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.331481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.395613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'flavor' on Instance uuid 3060a33f-220b-4ef5-a330-ffca8c4c871e {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:35:25.943301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:25.943929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:25.949725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.950198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.950619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:25.951324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:25.951765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:25.952178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.041445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-12a6a38f-d905-4935-8c60-5e121d40d8bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e/action" status: 200 len: 32 microversion: 2.1 time: 0.724702 Sep 05 14:35:26.042056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 107/214] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:35:25 2022] POST /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e/action => generated 32 bytes in 726 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 05 14:35:26.047079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:26.047761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:26.054980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:26.055459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:26.055884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.056563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:26.057002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:26.057422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.082101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:26.089947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-314c076f-ebd7-4c9b-b80d-c0ae1372c254 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.150413 Sep 05 14:35:26.090511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 108/215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:25 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:26.095535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:26.096312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:26.102711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:26.103415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:26.103934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.104634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:26.105343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:26.105769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.239402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:26.247140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b19b08ab-4705-4f99-b9b0-311e86779ef3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.203962 Sep 05 14:35:26.247698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 108/216] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:26 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:26.266068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:26.274469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e038af1d-8c70-4ed7-8c30-9a4f0f4d085b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.182798 Sep 05 14:35:26.275047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 109/217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:26 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:26.326021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:26.326662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:26.333174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:26.333592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:26.334027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.334718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:26.335228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:26.335650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:26.460786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:26.469096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:26.470623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:26.471798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2481d11a-3528-4183-9b02-6aa92871bb17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.149724 Sep 05 14:35:26.472378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 109/218] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:27.112621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:27.113223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:27.119134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.119612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.120046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.120720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.121167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.121631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.249269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:27.257495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1ca8a67b-c272-4abd-a4ef-18bfb4e6018a tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.148651 Sep 05 14:35:27.258058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 110/219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:27 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:27.269916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:27.270527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:27.276666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.277175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.277677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.278360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.278834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.279262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.297735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:27.299785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:27.307113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.307593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.308020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.308698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.309141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.309558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.465179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:27.473466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06b2a810-a566-41fa-ba3e-3210bb3e246a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.207976 Sep 05 14:35:27.474019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 110/220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:27 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:27.497062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:27.497601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:27.498203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:27.504754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.505230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.505483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a8771446-dba5-4563-929d-eb198d4494e6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.211603 Sep 05 14:35:27.505648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.506236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 111/221] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:27 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:27.506459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:27.507006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:27.507422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:27.646988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:27.650502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:27.655565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:27.657022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:27.658149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c8cc3a58-3468-4763-98c9-7dbd6a585354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.164891 Sep 05 14:35:27.663054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 111/222] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:28.280787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:28.283385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:28.287791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.288272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.288701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.289381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.289826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.290246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.294193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:28.433810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:28.441362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-42c68611-813c-4d47-bc98-72d4bd7eaf00 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.164407 Sep 05 14:35:28.441919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 112/223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:28 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:28.496747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:28.497259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:28.503515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.503997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.504407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.505076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.505513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.505925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.527627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:28.528233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:28.534744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.535262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.535693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.536437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.536894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.537345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.707726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:28.710676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:28.715684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc2c70c8-3816-4dfb-a77a-018d46851f1d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.223076 Sep 05 14:35:28.716251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 112/224] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:28 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:28.719281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c704415-45ee-4418-8c47-8a29cd0c016a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.195261 Sep 05 14:35:28.719962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 113/225] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:28 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:28.721603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:28.722202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:28.727889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.728358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.728782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.729458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:28.729900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:28.730315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:28.856818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:28.864735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:28.866175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:28.867315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3870dba-5814-4579-a746-dc92ce45b99e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.150089 Sep 05 14:35:28.867863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 113/226] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:29.465758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:29.466264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:29.472960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.476232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.476232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.476232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.476232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.476544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.602950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:29.610590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4003a92b-b453-458c-847a-43e2b868c34e tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1314 microversion: 2.1 time: 0.150173 Sep 05 14:35:29.611192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 114/227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:29 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:29.738856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:29.740038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:29.742148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:29.742963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:29.746111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.746693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.747245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.748207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.748766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.748869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.749343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.749454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.749774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.750460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.750943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.751880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.942337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:29.945408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:29.950251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f1e7970-421c-4b77-ad19-a5a9ad8f097b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.215645 Sep 05 14:35:29.950941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 114/228] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:29 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:29.953827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-45d6151c-d591-4bd9-b1d4-12850f62196e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.215695 Sep 05 14:35:29.954880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 115/229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:29 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:29.955367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:29.955980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:29.961816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.962296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.962729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:29.963464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:29.963944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:29.965241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:30.098082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:30.106175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:30.107628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:30.108720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f11b6c2e-c45a-476b-899f-051ee1ea8059 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.156882 Sep 05 14:35:30.109271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 115/230] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:30.633627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:30.634233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:30.640279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:30.640759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:30.641192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:30.642514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:30.642995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:30.643418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:30.770687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:30.778308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c4e1282-a202-4f93-82ea-5c93e0f62d64 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1500 microversion: 2.1 time: 0.148611 Sep 05 14:35:30.778896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 116/231] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:30 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1500 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:30.974778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:30.975399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:30.981282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:30.981755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:30.982180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:30.985363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:30.985363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:30.985363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:30.991059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:30.991658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:30.997461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:30.997935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:30.998362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:30.999560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:30.999560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:30.999909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:31.186009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:31.190449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:31.194686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5b316ccb-ca35-44c7-a20d-c00212f61dc3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.223721 Sep 05 14:35:31.195497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 116/232] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:30 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:31.198526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9b57a515-ca09-4e33-8bdf-919095d43372 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.211182 Sep 05 14:35:31.199426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 117/233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:30 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:31.209411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:31.211212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:31.217594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:31.218070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:31.218493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:31.219213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:31.219673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:31.220592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:31.348220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:31.356740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:31.358185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:31.359325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb3bbfb6-9d1a-449b-aeab-5be47f572cf5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.163129 Sep 05 14:35:31.360149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 117/234] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:32.217742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:32.218342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:32.220698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:32.221325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:32.224871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:32.225345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:32.225771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:32.226447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:32.226916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:32.227100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:32.227338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:32.227567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:32.227993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:32.228662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:32.229104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:32.229521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:32.418775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:32.424071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:32.427031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8968c239-bd9e-40cb-989d-1ed4006e1d53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.210754 Sep 05 14:35:32.427601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 118/235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:32 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:32.430333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d6e87542-5484-421d-949c-d310008cc4c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.216649 Sep 05 14:35:32.431269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 118/236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:32 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:32.432724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:32.433323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:32.439239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:32.439706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:32.440127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:32.440802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:32.441406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:32.441822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:32.570008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:32.577957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:32.580093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:32.581184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3f9b6aba-4149-4328-baa7-504a3e8b1ff4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.152672 Sep 05 14:35:32.581736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 119/237] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:33.449402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:33.449991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:33.452851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:33.453467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:33.455914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:33.456385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:33.456812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:33.457486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:33.457937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:33.458354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:33.459335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:33.459809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:33.460232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:33.460921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:33.461341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:33.461750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:33.651361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:33.654579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:33.659756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-19a3b45d-ea12-4020-b2ee-acbd75e30f22 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.214159 Sep 05 14:35:33.660346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 119/238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:33 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:33.663222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-083dec22-da7f-46cc-b36c-c1aa820938a9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.214067 Sep 05 14:35:33.663977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 120/239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:33 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:33.665194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:33.665796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:33.671981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:33.673892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:33.673892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:33.674484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:33.675096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:33.675605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:33.817683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:33.825722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:33.827186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:33.828264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-24095dc2-5035-4343-af34-51af9102acbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.167027 Sep 05 14:35:33.828805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 120/240] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:34.683279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:34.683826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:34.686408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:34.687059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:34.689904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:34.690387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:34.690835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:34.691525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:34.692087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:34.692509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:34.693013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:34.693485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:34.693911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:34.694586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:34.695252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:34.695668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:34.889856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:34.896566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:34.897682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-793b3e2d-3ecf-4c9b-8a69-163c768f7292 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.218398 Sep 05 14:35:34.898245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 121/241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:34 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:34.902770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:34.903388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:34.904343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-479d9044-5c8b-4400-8ace-fbafe102656f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.221794 Sep 05 14:35:34.904899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 121/242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:34 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:34.909712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:34.910264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:34.910760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:34.911554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:34.912074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:34.912566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:35.071275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:35.080748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:35.097435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:35.097435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bbf4e32a-f3c3-442d-8405-5e8736cc8aa0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.184848 Sep 05 14:35:35.097435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 122/243] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:35.920587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:35.937964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:35.938603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:35.939664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:35.948400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:35.948561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:35.948878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:35.949034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:35.949302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:35.949416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:35.950112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:35.950217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:35.950559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:35.950674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:35.951008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:35.951113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:36.164077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:36.171714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:36.179207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3664d83d-c1eb-42f8-b183-d21c128fe4e6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.245037 Sep 05 14:35:36.180111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 123/244] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:35 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:36.180584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a769f9ab-f1f3-4aad-ba41-796c5af4f65e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.263720 Sep 05 14:35:36.182375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 122/245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:35 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:36.199444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:36.200068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:36.206983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:36.207527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:36.208020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:36.209048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:36.209721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:36.210211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:36.347299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:36.355061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:36.356509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:36.357691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e1a6dc07-fa4a-482a-879a-91a4b60747a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.176117 Sep 05 14:35:36.358247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 124/246] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:37.206576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:37.207204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:37.211326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:37.211930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:37.213188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:37.213663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:37.214090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:37.215038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:37.215483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:37.215895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:37.218162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:37.218638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:37.219106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:37.220287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:37.220741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:37.221157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:37.549146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:37.555999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:37.560649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0c91314-c040-4025-bc01-175d73a65626 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.357800 Sep 05 14:35:37.561229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 123/247] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:37 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:37.563932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0076bd29-0f08-4ab6-b5b4-9928b885fe9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.356350 Sep 05 14:35:37.564597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 125/248] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:37 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:37.565680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:37.567026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:37.572955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:37.573537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:37.574061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:37.574856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:37.575433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:37.575945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:37.702004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:37.709893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:37.711442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:37.712520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b72e187c-495b-4b70-ad80-65bceccb84d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.150398 Sep 05 14:35:37.713063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 124/249] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:38.583802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:38.584400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:38.587172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:38.587776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:38.590619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:38.591124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:38.591548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:38.592221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:38.592662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:38.593071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:38.593983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:38.594476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:38.594950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:38.595649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:38.596100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:38.596520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:38.781821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:38.784946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:38.789465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e7a9283-7c07-489a-835f-86669f87573b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.205967 Sep 05 14:35:38.790128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 125/250] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:38 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:38.792802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-436f1203-b473-433f-a998-c5a7dc847939 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.213496 Sep 05 14:35:38.793497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 126/251] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:38 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:38.794759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:38.795379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:38.801121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:38.801594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:38.802025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:38.802701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:38.803170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:38.803590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:38.933375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:38.942062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:38.943558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:38.944644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-154ea778-706e-4c3c-9cc1-80c64e856156 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.153620 Sep 05 14:35:38.945179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 126/252] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:39.812022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:39.812626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:39.815692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:39.816291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:39.819389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:39.819867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:39.820295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:39.820979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:39.821425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:39.821850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:39.822062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:39.822539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:39.823010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:39.823680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:39.824120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:39.824534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:40.008368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:40.016181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-43d24172-2628-4e7e-ac3a-c9babcec8799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.208020 Sep 05 14:35:40.021241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 127/253] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:39 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:40.021382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:40.021690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:40.022319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:40.027985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:40.028469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:40.028778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a9502518-e8d8-40b6-9bfd-0324897f3cd9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.217298 Sep 05 14:35:40.028997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:40.029514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 127/254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:39 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:40.029693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:40.030122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:40.030708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:40.049456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:40.161750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:40.169611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:40.171081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:40.172177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f7429ef-3d59-48b2-a0a2-d00de77617c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.154172 Sep 05 14:35:40.172726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 128/255] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:41.039451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:41.040143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:41.045990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:41.046462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:41.046910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:41.047762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:41.048856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:41.049274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:41.053162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:41.053803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:41.059616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:41.060090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:41.060519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:41.063907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:41.063907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:41.063907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:41.292175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:41.296322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:41.301792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-743d22a4-ce7a-4da6-a889-0f9c1b3e733f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.265858 Sep 05 14:35:41.324897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 128/256] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:41 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:41.325000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:41.325000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c7e66444-16fa-4b77-8f22-268e2d57bbdc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.274712 Sep 05 14:35:41.325453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:41.326541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:41.334282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:41.335137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:41.335745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:41.336749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 129/257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:41 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:41.337054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:41.337673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:41.338305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:41.471441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:41.479297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:41.480720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:41.481796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4fd7087d-6f34-48b4-aed6-5d4cae1b0a49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.161186 Sep 05 14:35:41.482343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 129/258] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:42.326105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:42.326714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:42.332681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:42.333148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:42.333569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:42.334234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:42.334676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:42.335166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:42.348674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:42.349359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:42.356192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:42.356671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:42.357097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:42.357781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:42.358230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:42.358642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:42.559729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:42.561704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:42.569368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dd0fa065-e46d-4449-9da5-e5dffb6903d9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1366 microversion: 2.1 time: 0.225153 Sep 05 14:35:42.582989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 130/259] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:42 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1366 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:42.590375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:42.591014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:42.594357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-463398ac-23a5-4d0f-9d16-de45a84dd315 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.265072 Sep 05 14:35:42.595692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 130/260] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:42 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:42.606939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:42.609549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:42.611624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:42.612443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:42.614151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:42.614972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:42.754802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:42.762890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:42.764313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:42.765393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-937feff2-daa1-4575-a3eb-fd631eafd30c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.181156 Sep 05 14:35:42.765991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 131/261] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:43.357036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2ad773a6-8f55-4c73-8d52-9022cba64224"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:43.363878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:43.366738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:43.367246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:43.367676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:43.368396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:43.368851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:43.369261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:43.596544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:43.597203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:43.603056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:43.603449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:43.603875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:43.604546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:43.604989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:43.605401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:43.736947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:43.746725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-25e6699c-7c8d-4774-b8bd-9e68ab579861 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1556 microversion: 2.1 time: 0.153996 Sep 05 14:35:43.765190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 132/262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:43 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:43.779354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:43.780367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:43.787199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:43.787883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:43.788310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:43.789001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:43.789446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:43.789861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:44.018342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:44.029759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-35a6493c-b2b4-48dc-855e-1b687b6d0992 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.261612 Sep 05 14:35:44.029759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 133/263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:43 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:44.034218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:44.034752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:44.040720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:44.041194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:44.041659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:44.042360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:44.042866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:44.043314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:44.291668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a0954229-6931-4995-853a-1730bea2eca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.262258 Sep 05 14:35:44.292262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 134/264] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 14:35:44 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-interface => generated 285 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:44.296924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:44.297529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:44.304105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:44.304590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:44.305021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:44.305711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:44.306163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:44.306707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:44.482625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:44.502911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:44.505451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:44.506905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6ae9bf0-418c-4cf1-867e-bae9dd0aa7ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.213646 Sep 05 14:35:44.508740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 135/265] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:35:45.052666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:45.054037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:45.056104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=92 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:45.060941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:45.061442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:45.062044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:45.062817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:45.063457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:45.064576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:45.235641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:45.243752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee5bdccc-3000-411d-a415-753c0f059cdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.195934 Sep 05 14:35:45.244323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 136/266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:45 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:45.534160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:45.534886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:45.540809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:45.543633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:45.543633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:45.543633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:45.543633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:45.544010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:45.714614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:45.728549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:45.732561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:45.732561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9849f957-f7e6-4408-b905-2a115bc5ed4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.201834 Sep 05 14:35:45.732561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 137/267] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:45.758292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-2679a7d0-b10a-46a9-bd49-532d6049693e req-c0c57450-d740-4c07-96d1-7463c111f55d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57a94776-abef-42ea-a633-c70dedfdacab", "tag": "c898cf19-a336-4343-9ccc-5bdb6f2eb060"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:45.769088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2679a7d0-b10a-46a9-bd49-532d6049693e req-c0c57450-d740-4c07-96d1-7463c111f55d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:45.769569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2679a7d0-b10a-46a9-bd49-532d6049693e req-c0c57450-d740-4c07-96d1-7463c111f55d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:45.770005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2679a7d0-b10a-46a9-bd49-532d6049693e req-c0c57450-d740-4c07-96d1-7463c111f55d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:45.785323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-2679a7d0-b10a-46a9-bd49-532d6049693e req-c0c57450-d740-4c07-96d1-7463c111f55d service nova] Creating event network-changed:c898cf19-a336-4343-9ccc-5bdb6f2eb060 for instance 57a94776-abef-42ea-a633-c70dedfdacab on hv-cinder-84290 Sep 05 14:35:45.791210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-2679a7d0-b10a-46a9-bd49-532d6049693e req-c0c57450-d740-4c07-96d1-7463c111f55d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036615 Sep 05 14:35:45.791942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 138/268] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:35:46.268770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:46.269810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:46.276139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:46.276700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:46.277196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:46.278072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:46.278553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:46.279006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:46.418421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:46.426954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dff611c5-d719-4cdb-b0d8-7a81fe1f23c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.163076 Sep 05 14:35:46.427529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 139/269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:46 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:46.758144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:46.759069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:46.765002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:46.765493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:46.765927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:46.766655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:46.767199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:46.767621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:46.906263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:46.920066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:46.921543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:46.923447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-29cead2f-0faa-4cd5-8cb1-2294d025c1ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.168494 Sep 05 14:35:46.924030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 140/270] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:47.450715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:47.451422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:47.457464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:47.457938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:47.458368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:47.459072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:47.459517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:47.459928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:47.599860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:47.607412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6fd98769-66df-4952-9382-1912e073bbf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.160691 Sep 05 14:35:47.607977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 141/271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:47 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:47.949019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:47.949668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:47.956085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:47.956563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:47.956993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:47.957728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:47.958174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:47.958593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:48.106218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:48.115820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:48.117269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:48.118467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c98f6018-8ef2-45d5-865d-82dd6ec59f87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1407 microversion: 2.20 time: 0.173401 Sep 05 14:35:48.123306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 142/272] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1407 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:48.631070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:48.631665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:48.637557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:48.638027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:48.638455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:48.639150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:48.639596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:48.640008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:48.784320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:48.793302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96b208f2-655f-4564-bfd2-9e715592e166 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.166029 Sep 05 14:35:48.799228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 143/273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:48 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:49.144875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:49.145462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:49.155716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:49.156206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:49.156646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:49.157897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:49.158345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:49.158764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:49.362765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:49.373408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:49.374937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:49.376637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8830204b-7074-4e3f-9ace-e28d2563208b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1598 microversion: 2.20 time: 0.235408 Sep 05 14:35:49.378827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 144/274] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:35:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1598 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:35:49.402635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:49.403157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:49.411081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:49.413018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:49.413508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:49.414265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:49.414746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:49.415200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:49.561440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4c91b0f9-6828-43db-8982-af464072bb76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.162390 Sep 05 14:35:49.571275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 145/275] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Sep 5 14:35:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-interface => generated 284 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:35:49.817665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:49.824075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:49.825173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:49.825833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:49.826265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:49.827151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:49.827599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:49.828016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:50.463665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:50.464205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-032d3191-bca3-4fe3-90fe-75c1d750180b tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "POST /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.110901 Sep 05 14:35:50.466696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 131/276] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:35:43 2022] POST /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169/os-volume_attachments => generated 194 bytes in 7114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:50.470679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:50.479478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ed010791-3198-4fbc-bed5-a1fa40bd76f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.666428 Sep 05 14:35:50.480844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 146/277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:49 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:35:51.508943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:51.509661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:51.512449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=71 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:35:51.518322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:51.518833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:51.519274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:51.519995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:51.520445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:51.520867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:51.713662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-5b9f1603-ba5b-40ed-8717-733a4da6f3da req-71f951b1-f8f7-4e70-9207-2705d9c942b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:35:51.725184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:51.729445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-5b9f1603-ba5b-40ed-8717-733a4da6f3da req-71f951b1-f8f7-4e70-9207-2705d9c942b3 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:51.730086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-5b9f1603-ba5b-40ed-8717-733a4da6f3da req-71f951b1-f8f7-4e70-9207-2705d9c942b3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:51.730682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-5b9f1603-ba5b-40ed-8717-733a4da6f3da req-71f951b1-f8f7-4e70-9207-2705d9c942b3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:51.738445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-efab59fb-e0d8-445f-bf79-13e407a1af7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.233500 Sep 05 14:35:51.742467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-5b9f1603-ba5b-40ed-8717-733a4da6f3da req-71f951b1-f8f7-4e70-9207-2705d9c942b3 service nova] Creating event network-changed:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:35:51.747891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 132/278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:51 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:51.757763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-5b9f1603-ba5b-40ed-8717-733a4da6f3da req-71f951b1-f8f7-4e70-9207-2705d9c942b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047894 Sep 05 14:35:51.758367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 147/279] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:35:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:35:52.761523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:52.762137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:52.770712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:52.771220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:52.771925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:52.772616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:52.773065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:52.773474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:52.959033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:52.967305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-12c67451-df66-46d0-864c-0dfda60dde52 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.209609 Sep 05 14:35:52.968053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 133/280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:52 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:53.990113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:53.990813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:53.997868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:53.998347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:54.002704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:54.002704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:54.002704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:54.002704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:54.128788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:54.136464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1c2cb65a-8af2-4b76-a304-e146e67036fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.150620 Sep 05 14:35:54.137029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 148/281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:53 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:55.158855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:55.159457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:55.165861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:55.166328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:55.166755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:55.167725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:55.168485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:55.168904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:55.297645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:55.305770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4f7229d5-f88a-4f0c-acec-46eef7e4c98b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.151121 Sep 05 14:35:55.306317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 134/282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:55 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:56.328347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:56.328981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:56.335060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:56.335534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:56.335956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:56.336628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:56.337072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:56.337485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:56.463379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:56.471305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2fa12139-26a0-4345-8792-627cbc070b53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.146750 Sep 05 14:35:56.471863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 149/283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:56 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:57.493219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:57.493817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:57.500251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:57.500723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:57.501148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:57.501822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:57.502266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:57.502678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:57.638175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:57.646633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-838566aa-8d98-4e4d-a7c3-28f7659a8972 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.157211 Sep 05 14:35:57.647220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 135/284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:57 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:58.669133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:58.669660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:58.676411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:58.676894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:58.677329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:58.678014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:58.678465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:58.678921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:58.804747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:58.812446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3f4fd6d-caa9-4a63-ba2b-592c7a24b912 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.147292 Sep 05 14:35:58.813050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 150/285] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:58 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:35:59.835313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:35:59.835924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:35:59.842600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:59.843110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:59.843542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:59.844222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:35:59.844718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:35:59.845136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:35:59.972963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:35:59.979327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e80bb93c-d622-42be-9fb3-1dd7892133c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.147949 Sep 05 14:35:59.979880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 136/286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:35:59 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:01.002711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:01.003362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:01.009708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:01.010192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:01.010630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:01.011343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:01.011800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:01.012221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:01.143751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:01.151341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e808c53-e5eb-471f-ac23-bc9d68c770cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.153081 Sep 05 14:36:01.151898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 151/287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:00 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:02.173325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:02.173946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:02.180278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:02.180748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:02.181175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:02.181846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:02.182290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:02.186017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:02.315896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:02.323564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ea2b819a-8d0d-441b-b057-bd49217d663d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.154081 Sep 05 14:36:02.324114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 137/288] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:02 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:03.347318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:03.347838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:03.353618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:03.354095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:03.354525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:03.355227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:03.355673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:03.356091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:03.485358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:03.492811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b2ced8d9-5ae1-4ead-ba1f-187889ccf89e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.150060 Sep 05 14:36:03.493389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 152/289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:03 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:04.515751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:04.516900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:04.523182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:04.523658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:04.524110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:04.524786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:04.525230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:04.525645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:04.652324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:04.660822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c1beab0b-048f-4216-b2aa-3246c26a795b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.148891 Sep 05 14:36:04.661384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 138/290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:04 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:05.684103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:05.684714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:05.691182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:05.691670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:05.692104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:05.692810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:05.694923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:05.695396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:05.841587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:05.849914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-87d99684-17bc-42a0-b60c-da7c5ab9c9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.169721 Sep 05 14:36:05.850481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 153/291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:05 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:06.873263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:06.873950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:06.880613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:06.881099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:06.881535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:06.882224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:06.882749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:06.883130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:07.017581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:07.025267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-74ce791c-1b4b-444a-bdc0-cbc6dba39107 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.155789 Sep 05 14:36:07.025836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 139/292] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:06 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:08.048396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:08.049000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:08.054847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:08.055330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:08.055793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:08.056474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:08.056960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:08.057402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:08.189873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:08.197632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2784d5c0-2220-4136-a344-a42a47d1dd55 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.153757 Sep 05 14:36:08.198182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 154/293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:08 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:09.220026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:09.220694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:09.227127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:09.227605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:09.228033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:09.228706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:09.229182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:09.229602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:09.362944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:09.370498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-00f2ca7d-f50c-46d7-9bb3-1542c14796c0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.154247 Sep 05 14:36:09.371090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 140/294] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:09 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:10.393490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:10.394012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:10.400144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:10.400619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:10.401131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:10.401809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:10.402257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:10.402674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:10.528137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:10.536399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-36e8d281-6765-4aef-9e35-9b0f3d1715d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.147422 Sep 05 14:36:10.536954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 155/295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:10 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:11.558983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:11.559722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:11.566061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:11.566544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:11.567087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:11.567773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:11.568226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:11.568654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:11.572572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=80,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:11.699104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:11.706782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-edc457bf-fcbf-4641-bc71-6acced55c9ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.151731 Sep 05 14:36:11.707383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 141/296] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:11 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:12.729221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:12.729868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:12.736172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:12.736646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:12.737069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:12.737739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:12.738180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:12.738590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:12.866267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:12.874071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-78f22393-60f1-4c9a-9b8c-fde5a362b95a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.148594 Sep 05 14:36:12.874781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 156/297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:12 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:13.896783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:13.897386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:13.903466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:13.903942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:13.904377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:13.905155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:13.905605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:13.906028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:14.037399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:14.045712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80781a6a-2598-4e96-881b-0c280f66bfca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.152783 Sep 05 14:36:14.046824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 142/298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:13 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:15.069803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:15.070360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:15.077712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:15.077937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:15.078519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:15.079221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:15.079671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:15.080101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:15.216695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:15.224478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1ac2762-31ac-4d9c-b7f9-556d1d387b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.158617 Sep 05 14:36:15.225032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 157/299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:15 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:16.248304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:16.248913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:16.256322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:16.256612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:16.257039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:16.257725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:16.258732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:16.259181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:16.397740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:16.409055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2307c180-f46f-4dda-b169-5c6d84d1e9f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1521 microversion: 2.1 time: 0.161935 Sep 05 14:36:16.419538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 143/300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:16 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:17.364262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:17.364826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:17.366666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=44 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:17.371273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.371747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.372170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.372847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.373288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.373701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.400887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:36:17.430097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:17.430520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:17.439024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.440101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.440723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.441608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.442214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.442898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.636215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:17.643982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c2c3362a-ec7b-45b5-b99b-f9048a5c5e99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1501 microversion: 2.1 time: 0.218388 Sep 05 14:36:17.644557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 144/301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:17 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1501 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:17.666783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:17.667339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:17.673869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.677774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.677774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.677774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.677774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.678118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.800779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0b754dbe-afcf-416e-a332-ef14855cdd11 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 204 len: 0 microversion: 2.1 time: 0.439230 Sep 05 14:36:17.805909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 158/302] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:36:17 2022] DELETE /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:36:17.815232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:17.816353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:17.823755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.825107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.825643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:17.826967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:17.827544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:17.828318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:18.048496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:18.053992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:18.057523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3edf2b86-c5b5-4c5d-b0cb-4fba4ccd0c2e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1515 microversion: 2.1 time: 0.394995 Sep 05 14:36:18.063742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cd12526e-c6fc-4afc-a631-0187555e6f0c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1552 microversion: 2.1 time: 0.254610 Sep 05 14:36:18.064758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 159/304] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:17 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1552 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:18.067886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 145/304] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:17 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1515 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:19.102936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:19.102936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:19.113597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:19.116072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:19.118377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:19.119699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:19.125893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:19.125893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:19.284599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:19.293139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0c89d154-75dc-44aa-b249-28da9944c197 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1552 microversion: 2.1 time: 0.203514 Sep 05 14:36:19.293702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 146/305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:19 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1552 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:20.319489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:20.320391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:20.326826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:20.327520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:20.328086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:20.329183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:20.329736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:20.330364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:20.607640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:20.616577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-250f80ae-8079-498a-a98e-6b350e5ba810 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1552 microversion: 2.1 time: 0.301406 Sep 05 14:36:20.617357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 160/306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:20 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1552 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:21.118245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:21.120778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:21.128609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.129107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.129714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.130573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.131149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.131570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.154738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'flavor' on Instance uuid 90621a62-caad-4a01-97cf-67f270d9de0b {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:36:21.311701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-8bb0ae52-c88c-4822-9cfa-bac5c3a25e75 req-abd328f0-be2d-47f2-8cf9-a97eece582c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffb7ea1-4123-4566-abf2-23b62cc9a169", "name": "network-vif-deleted", "tag": "75fd2d9a-1850-4c10-8651-4ce1cf876222"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:21.328756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8bb0ae52-c88c-4822-9cfa-bac5c3a25e75 req-abd328f0-be2d-47f2-8cf9-a97eece582c3 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.329868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8bb0ae52-c88c-4822-9cfa-bac5c3a25e75 req-abd328f0-be2d-47f2-8cf9-a97eece582c3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.330319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8bb0ae52-c88c-4822-9cfa-bac5c3a25e75 req-abd328f0-be2d-47f2-8cf9-a97eece582c3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.348836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-8bb0ae52-c88c-4822-9cfa-bac5c3a25e75 req-abd328f0-be2d-47f2-8cf9-a97eece582c3 service nova] Creating event network-vif-deleted:75fd2d9a-1850-4c10-8651-4ce1cf876222 for instance dffb7ea1-4123-4566-abf2-23b62cc9a169 on hv-cinder-84290 Sep 05 14:36:21.355274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-8bb0ae52-c88c-4822-9cfa-bac5c3a25e75 req-abd328f0-be2d-47f2-8cf9-a97eece582c3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047576 Sep 05 14:36:21.356083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 161/307] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:36:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:36:21.521051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-89f8e8c7-d845-4151-910f-e16c48e3202e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/action" status: 200 len: 32 microversion: 2.1 time: 0.406656 Sep 05 14:36:21.526336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 147/308] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:36:21 2022] POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/action => generated 32 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 14:36:21.533205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:21.534104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:21.541429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.542145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.542655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.543387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.543835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.544249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.640852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:21.642200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:21.648425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.648908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.649344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.650047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:21.650503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:21.650980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:21.901056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:21.912966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-612aa3f5-e52c-4914-86d2-05c701321f6c tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1345 microversion: 2.1 time: 0.275360 Sep 05 14:36:21.912966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 148/309] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:21 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1345 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:21.926767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:21.935074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:21.939359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-477f0598-05df-4a0a-b9af-cb2d76daf8ab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.410794 Sep 05 14:36:21.950819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 162/310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:21 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:22.136173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-270606186", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "networks": [{"uuid": "ebaa9a3b-70be-4d21-ad3d-72a6b0dd80da"}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:22.204009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] validate_networks() for [('ebaa9a3b-70be-4d21-ad3d-72a6b0dd80da', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:36:22.911943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:36:22.911943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:36:22.912308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:36:22.912694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:36:22.913098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:36:22.916100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=36 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:22.924085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:22.924563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:22.924992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:22.925701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:22.926328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:22.926748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:22.936520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:22.937855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:22.945908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:22.946206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Getting quotas for project fc60ee38517541b8bc153807f5332011. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:36:22.946950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:22.947381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:22.948132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:22.949102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:22.949679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:22.950541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Getting quotas for user e8429576e286422cb09591897e82cd69 and project fc60ee38517541b8bc153807f5332011. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:36:22.963618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:36:22.966844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:36:22.984199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:22.985393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:22.986051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:22.986513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lazy-loading 'fault' on Instance uuid dffb7ea1-4123-4566-abf2-23b62cc9a169 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:36:23.041633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd31427f2a67e49d0b4d3e1b3cee8c48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3c30f843007d4200ac64e2189003698f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:23.051747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cff27412-1f0a-40cf-b8f8-34bea11b4f39 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 200 len: 1350 microversion: 2.1 time: 0.119370 Sep 05 14:36:23.052518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 163/311] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:22 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 1350 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:23.057751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:23.058390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:23.065667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:23.066156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:23.066580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:23.067893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:23.068258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:23.068840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:23.158575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9733752d-a722-46bd-8114-3d1d32be7eda tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.026896 Sep 05 14:36:23.164325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 149/312] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:36:22 2022] POST /compute/v2.1/servers => generated 380 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:36:23.193398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b4b95d8f-5ba3-43dc-bea5-c5ab98f6ab57 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:23.194014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b4b95d8f-5ba3-43dc-bea5-c5ab98f6ab57 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:23.266467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:23.274590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-670832b8-0d24-4df0-a296-3612d797226d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.220829 Sep 05 14:36:23.275290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 164/313] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:23 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:23.283063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b4b95d8f-5ba3-43dc-bea5-c5ab98f6ab57 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:23.290555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b4b95d8f-5ba3-43dc-bea5-c5ab98f6ab57 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1213 microversion: 2.1 time: 0.108171 Sep 05 14:36:23.291489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 150/314] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:23 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1213 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:24.077331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:24.079073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:24.085510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:24.086027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:24.086623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:24.087365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:24.088255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:24.088681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:24.106291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] HTTP exception thrown: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Request method failure captured: Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 HTTP/1.1 Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjzz_fQVap9w4RUDh7WnTawNm1eRghhzZAj7ihLpdt78BFnJQyd7o3t2-0AeflmPq235QlBR80fFjWqunnW6ic-9vnRLbbRzsbE0q3a86wK8bXv9m1VYuDiPJBn11ffiLDrNjYX7ERh5YytMUYmO3B2kqTb5OUWjQkkxWA_xNC08q8 Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:36:24.111031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c30f843007d4200ac64e2189003698f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c30f843007d4200ac64e2189003698f"}]}] Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: d31427f2a67e49d0b4d3e1b3cee8c48b Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.112543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': 'dffb7ea1-4123-4566-abf2-23b62cc9a169'} Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:36:24.113414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.115012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.116400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Returning 404 to user: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:36:24.116400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6c8d20a-6e01-4262-b1ab-e7dc104a6cca tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 404 len: 111 microversion: 2.1 time: 0.040194 Sep 05 14:36:24.116400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 165/315] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:24 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:36:24.236211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:24.238437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:24.246295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:24.246955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:24.247537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:24.248233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:24.248680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:24.249780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:24.265512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] HTTP exception thrown: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Request method failure captured: Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169/os-volume_attachments HTTP/1.1 Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjzz_fQVap9w4RUDh7WnTawNm1eRghhzZAj7ihLpdt78BFnJQyd7o3t2-0AeflmPq235QlBR80fFjWqunnW6ic-9vnRLbbRzsbE0q3a86wK8bXv9m1VYuDiPJBn11ffiLDrNjYX7ERh5YytMUYmO3B2kqTb5OUWjQkkxWA_xNC08q8 Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:36:24.270940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c30f843007d4200ac64e2189003698f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c30f843007d4200ac64e2189003698f"}]}] Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: d31427f2a67e49d0b4d3e1b3cee8c48b Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.272419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'server_id': 'dffb7ea1-4123-4566-abf2-23b62cc9a169'} Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:36:24.273264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:24.275026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:24.276430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Returning 404 to user: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:36:24.276430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-90dbfcd6-cb8e-40b0-b3fb-342c875d0853 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.040318 Sep 05 14:36:24.276430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 151/316] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:36:24 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169/os-volume_attachments => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:36:24.297963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:24.298617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:24.308293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:24.308783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:24.314241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f631175f-55db-4046-a73b-f38e0c4a110e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:24.314892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f631175f-55db-4046-a73b-f38e0c4a110e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:24.319347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:24.320029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:24.322951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:24.322951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:24.391851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f631175f-55db-4046-a73b-f38e0c4a110e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:24.399116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f631175f-55db-4046-a73b-f38e0c4a110e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1213 microversion: 2.1 time: 0.089015 Sep 05 14:36:24.400234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 152/317] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:24 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:24.512469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:24.520762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9597ced-b982-4107-9694-09781b2e4015 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.226973 Sep 05 14:36:24.521410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 166/318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:24 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:25.426147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:25.426831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:25.436780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.437333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.437720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.439071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.439493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.439917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.513636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:25.521432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-510abf2c-1f33-4ee8-9751-8a0834ba1da5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1265 microversion: 2.1 time: 0.099597 Sep 05 14:36:25.522140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 153/319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:25 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1265 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:25.545289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:25.545911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:25.553600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.554097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.554531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.555254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.555713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.556170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.701644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:25.716806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b12f441e-3904-4d27-8b8d-833542ad8056 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.175856 Sep 05 14:36:25.720041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 167/320] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:25 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:25.872294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:25.872795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:25.879575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.880062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.880498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.881179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.881628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.882214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.897009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] HTTP exception thrown: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Request method failure captured: Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 HTTP/1.1 Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjzz_fQVap9w4RUDh7WnTawNm1eRghhzZAj7ihLpdt78BFnJQyd7o3t2-0AeflmPq235QlBR80fFjWqunnW6ic-9vnRLbbRzsbE0q3a86wK8bXv9m1VYuDiPJBn11ffiLDrNjYX7ERh5YytMUYmO3B2kqTb5OUWjQkkxWA_xNC08q8 Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:36:25.901502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c30f843007d4200ac64e2189003698f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c30f843007d4200ac64e2189003698f"}]}] Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: d31427f2a67e49d0b4d3e1b3cee8c48b Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.903802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': 'dffb7ea1-4123-4566-abf2-23b62cc9a169'} Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:36:25.904626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.905949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.907344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Returning 404 to user: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:36:25.907344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5da65639-3320-45aa-916b-e21a7fdb1225 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 404 len: 111 microversion: 2.1 time: 0.033583 Sep 05 14:36:25.907344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 154/321] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:36:25 2022] DELETE /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:36:25.909280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:25.909835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] [instance: dffb7ea1-4123-4566-abf2-23b62cc9a169] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:25.916052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.916541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.917176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.917877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:25.918499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:25.918996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:25.933010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] HTTP exception thrown: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Request method failure captured: Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 HTTP/1.1 Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjzz_fQVap9w4RUDh7WnTawNm1eRghhzZAj7ihLpdt78BFnJQyd7o3t2-0AeflmPq235QlBR80fFjWqunnW6ic-9vnRLbbRzsbE0q3a86wK8bXv9m1VYuDiPJBn11ffiLDrNjYX7ERh5YytMUYmO3B2kqTb5OUWjQkkxWA_xNC08q8 Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:36:25.935831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/3c30f843007d4200ac64e2189003698f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/3c30f843007d4200ac64e2189003698f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_3c30f843007d4200ac64e2189003698f"}]}] Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 3c30f843007d4200ac64e2189003698f Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-DeleteServersTestJSON-1227417230 Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: d31427f2a67e49d0b4d3e1b3cee8c48b Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-DeleteServersTestJSON-1227417230-project Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': 'dffb7ea1-4123-4566-abf2-23b62cc9a169'} Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:36:25.942311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. Sep 05 14:36:25.943729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:25.944938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] Returning 404 to user: Instance dffb7ea1-4123-4566-abf2-23b62cc9a169 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:36:25.944938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b16440a-6ab9-47fb-abd6-e16656f387f0 tempest-DeleteServersTestJSON-1227417230 tempest-DeleteServersTestJSON-1227417230-project] 10.222.0.15 "GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169" status: 404 len: 111 microversion: 2.1 time: 0.030520 Sep 05 14:36:25.944938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 168/322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:25 2022] GET /compute/v2.1/servers/dffb7ea1-4123-4566-abf2-23b62cc9a169 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:36:26.550608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:26.557402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:26.559416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:26.560454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:26.560988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:26.561914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:26.562368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:26.563499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:26.720304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:26.739325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3e7b3adc-e6dd-4b36-8e70-f41073677c7c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1283 microversion: 2.1 time: 0.184690 Sep 05 14:36:26.739325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 155/323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:26 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1283 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:26.743909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:26.745092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:26.752900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:26.753470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:26.754118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:26.754993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:26.756136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:26.756717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:27.142834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:27.153457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ad49de0-d258-4401-8ebb-b919112fa79a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.416333 Sep 05 14:36:27.154154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 169/324] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:26 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:27.758628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:27.759264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:27.770553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:27.771315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:27.772029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:27.776724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:27.777342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:27.777849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:28.177211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:28.177846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:28.186368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:28.186368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:28.194067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:28.199288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:28.199288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:28.199288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:28.246041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:28.255247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a00460ad-096f-4d24-96dc-e039381e8958 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.500372 Sep 05 14:36:28.262827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 156/325] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:27 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:28.559964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:28.568504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce48c3a8-809f-4f62-bc3f-79656dda20ca tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.395604 Sep 05 14:36:28.569192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 170/326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:28 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:29.278844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:29.279616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:29.288092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:29.288803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:29.289235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:29.289923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:29.290562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:29.291014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:29.593205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:29.594811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:29.602874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:29.603992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:29.605234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:29.606256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:29.606993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:29.608078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:29.730173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:29.738708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-35f29f56-e9e6-465b-a46b-8403c54e309d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.463834 Sep 05 14:36:29.739558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 157/327] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:29 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:29.844303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:29.852709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f9adde2-15f2-4ffa-9c7d-0146f5144d1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.264459 Sep 05 14:36:29.865584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 171/328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:29 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:30.129686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-d015b2b5-95e6-4537-bab4-3e05ebe5c8b2 req-5e778d47-c139-43c6-a1db-0617f7d98d90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "026f3741-3da5-4073-b43d-dc925ac1b047", "tag": "444c688b-f5b5-4ead-ab50-adf37780b912"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:30.143377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-d015b2b5-95e6-4537-bab4-3e05ebe5c8b2 req-5e778d47-c139-43c6-a1db-0617f7d98d90 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:30.145662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-d015b2b5-95e6-4537-bab4-3e05ebe5c8b2 req-5e778d47-c139-43c6-a1db-0617f7d98d90 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:30.146252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-d015b2b5-95e6-4537-bab4-3e05ebe5c8b2 req-5e778d47-c139-43c6-a1db-0617f7d98d90 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:30.166364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-d015b2b5-95e6-4537-bab4-3e05ebe5c8b2 req-5e778d47-c139-43c6-a1db-0617f7d98d90 service nova] Creating event network-changed:444c688b-f5b5-4ead-ab50-adf37780b912 for instance 026f3741-3da5-4073-b43d-dc925ac1b047 on hv-cinder-84290 Sep 05 14:36:30.173380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-d015b2b5-95e6-4537-bab4-3e05ebe5c8b2 req-5e778d47-c139-43c6-a1db-0617f7d98d90 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049921 Sep 05 14:36:30.174292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 158/329] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:36:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:36:30.761803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:30.763136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:30.777887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:30.778397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:30.778821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:30.779726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:30.780323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:30.780912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:30.876893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:30.878423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:30.898152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:30.898639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:30.905919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:30.911413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:30.911903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:30.914477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:31.540058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:31.548418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:31.550298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-68b53449-7ea2-4ba1-ae0c-23185dd4b478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.678771 Sep 05 14:36:31.551114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 159/330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:30 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:31.571085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-384f160e-9f53-40d3-be22-5c1ac6f64d0e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.808030 Sep 05 14:36:31.571085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 172/331] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:30 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 809 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:32.573649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:32.574255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:32.584086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.594363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.596196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.597105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.597560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.598169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.598424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:32.599133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:32.610605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.613716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.614610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.615508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.616254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.616821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.634555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:32.847742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:32.859232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:32.866951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7e925c7-81a2-456a-8f3f-9378e1b91baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1501 microversion: 2.1 time: 0.297259 Sep 05 14:36:32.867122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6a5a0f60-ce1d-47b3-a564-e3da6d3e08c4 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.278097 Sep 05 14:36:32.867660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 173/332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:32 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:32.868415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 160/333] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:32 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1501 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:32.891914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d1308b9a-e32b-4bec-8caf-d6ee911d2820"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:32.894514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:32.900539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.902413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.903026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.904091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.904749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.905258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.930253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] HTTP exception thrown: Cannot 'attach_volume' instance 90621a62-caad-4a01-97cf-67f270d9de0b while it is in vm_state rescued Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Request method failure captured: Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/os-volume_attachments HTTP/1.1 Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 74 Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjvME7A0Oa-XHElvBJnAvhVALXYUKaCZry8Wznb1X8cZXgDmXzbJDt9GmasZp9dLO_bm1vCuWtDApCkJtVFPWhKFkqyEVbSIm1wLc1Mtto0I-3DysC1-aaIbYKyu1Ki3RBx4vPz8Qoy023vk1pa6_17adNlOqGIo-hAh9LW1U_N3do Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:36:32.932379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2af009055e3b4bdda73a770242253b0d"}]}] Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 9136f02e6c664f27b3f4fd35475f0eea Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {"volumeAttachment": {"volumeId": "d1308b9a-e32b-4bec-8caf-d6ee911d2820"}} Sep 05 14:36:32.933892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Cannot 'attach_volume' instance 90621a62-caad-4a01-97cf-67f270d9de0b while it is in vm_state rescued Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'server_id': '90621a62-caad-4a01-97cf-67f270d9de0b', 'body': {'volumeAttachment': {'volumeId': 'd1308b9a-e32b-4bec-8caf-d6ee911d2820'}}} Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 90621a62-caad-4a01-97cf-67f270d9de0b in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:36:32.934741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 90621a62-caad-4a01-97cf-67f270d9de0b while it is in vm_state rescued Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:32.941091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 90621a62-caad-4a01-97cf-67f270d9de0b while it is in vm_state rescued Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Returning 409 to user: Cannot 'attach_volume' instance 90621a62-caad-4a01-97cf-67f270d9de0b while it is in vm_state rescued {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-209ed4e1-e85c-478f-9ab1-8b4e859d24aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.046705 Sep 05 14:36:32.942497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 174/334] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:36:32 2022] POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/os-volume_attachments => generated 152 bytes in 48 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 05 14:36:32.944290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:32.944816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:32.946685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:32.951410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.951889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.952334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:32.952995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:32.953514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:32.953941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:33.222464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09248d54-d7cf-4381-b05a-22ef308810ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/action" status: 202 len: 0 microversion: 2.1 time: 0.282240 Sep 05 14:36:33.226058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 161/335] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:36:32 2022] POST /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b/action => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:36:33.231172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:33.231765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:33.238125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:33.238602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:33.239054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:33.239728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:33.240173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:33.240816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:33.374806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:33.380951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3b03ef00-7c6f-419c-bbee-34d9d4f42ce8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.153597 Sep 05 14:36:33.381652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 175/336] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:33 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:33.891115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:33.891807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:33.898179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:33.898658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:33.899131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:33.899814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:33.900267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:33.900690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:34.033890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:34.041641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6deca215-d132-4622-bf21-4125786a0db2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.155679 Sep 05 14:36:34.042228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 162/337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:33 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:34.410765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:34.411765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:34.422804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:34.423526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:34.424068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:34.425655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:34.426268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:34.427647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:34.564121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:34.573706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e6cd3ead-9828-48d7-8409-b73b5a02b218 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.169566 Sep 05 14:36:34.574301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 176/338] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:34 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:35.073922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:35.073922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:35.100762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=10 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:35.103154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:35.103848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:35.104245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:35.104934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:35.105544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:35.106338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:35.322945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:35.330710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-debf7a1f-585c-4a96-a99f-c654f74fcd54 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.269311 Sep 05 14:36:35.331303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 163/339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:35 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:35.597455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:35.598182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:35.604130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:35.604614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:35.605088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:35.605779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:35.606221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:35.606638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:36.102375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:36.114465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e757f1e8-f274-435b-849b-1b246192dfec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.518984 Sep 05 14:36:36.122937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 177/340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:35 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:36.353826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:36.354430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:36.361794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:36.362278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:36.362874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:36.363545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:36.363991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:36.364404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:36.545501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:36.555860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-50622f78-02cf-47b5-8e0b-d1dfed6b1ff8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.205896 Sep 05 14:36:36.563916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 164/341] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:36 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:37.143931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:37.147707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:37.157866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:37.158858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:37.159609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:37.160590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:37.161984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:37.163096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:37.314904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:37.322527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-517bafa7-1220-4e30-9e66-4f6045ea3b47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.186716 Sep 05 14:36:37.323119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 178/342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:37 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:37.579074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:37.579782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:37.587226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:37.591028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:37.591028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:37.591028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:37.591028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:37.591445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:37.753902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:37.762127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-65d47c1a-caf9-431a-979e-27ca343d689e tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.187649 Sep 05 14:36:37.762762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 165/343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:37 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:38.347085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:38.347817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:38.354062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:38.354703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:38.355235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:38.355930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:38.356376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:38.356792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:38.530046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:38.549149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c88e339-6c35-4630-8af0-51327f755314 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.206632 Sep 05 14:36:38.554142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 179/344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:38 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:38.786021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:38.786630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:38.807039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:38.807530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:38.807957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:38.808656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:38.809102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:38.809520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:38.996291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:39.004062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7c48beaa-b691-4f25-a88f-e05b2060ed4c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.222451 Sep 05 14:36:39.004816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 166/345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:38 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:39.577173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:39.577838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:39.588112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:39.588112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:39.588112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:39.588112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:39.588673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:39.588673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:39.722939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:39.742663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:39.742663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d8fcb142-f847-433e-bbbc-e31441df3475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.157967 Sep 05 14:36:39.742663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 180/346] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:39 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:40.026994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:40.043038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:40.043038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:40.043038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:40.043038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:40.043637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:40.043637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:40.043637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:40.228684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:40.239086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6c9c96f3-6cc1-4a3f-be98-0cb1d2b3fea8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.215925 Sep 05 14:36:40.239847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 167/347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:40 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:40.754904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:40.755523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:40.761693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:40.762180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:40.762811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:40.763533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:40.763990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:40.764415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:40.909632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:40.918120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2867b29-56fa-4ec1-80d0-e46598d35bd6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.167691 Sep 05 14:36:40.919142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 181/348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:40 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:41.261321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:41.261925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:41.271234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:41.271234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:41.271234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:41.271234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:41.271761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:41.271761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:41.501258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:41.511600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4bb76fc6-ed10-49ae-bc66-734f6ad06084 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.254043 Sep 05 14:36:41.512779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 168/349] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:41 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:41.941565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:41.942164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:41.948786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:41.949266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:41.949715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:41.950390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:41.950913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:41.951326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:42.091251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:42.103922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e756e33a-ec88-4258-a47f-3aa3e9a9d04b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1509 microversion: 2.1 time: 0.166131 Sep 05 14:36:42.104485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 182/350] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:41 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:42.352771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-079b345c-bd70-4a84-be22-590b98282eeb req-b8ac8de6-3241-4b81-83ea-3ef84801cbd7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026f3741-3da5-4073-b43d-dc925ac1b047", "name": "network-vif-plugged", "status": "completed", "tag": "444c688b-f5b5-4ead-ab50-adf37780b912"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:42.369897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-079b345c-bd70-4a84-be22-590b98282eeb req-b8ac8de6-3241-4b81-83ea-3ef84801cbd7 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:42.371692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-079b345c-bd70-4a84-be22-590b98282eeb req-b8ac8de6-3241-4b81-83ea-3ef84801cbd7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:42.372282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-079b345c-bd70-4a84-be22-590b98282eeb req-b8ac8de6-3241-4b81-83ea-3ef84801cbd7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:42.391848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-079b345c-bd70-4a84-be22-590b98282eeb req-b8ac8de6-3241-4b81-83ea-3ef84801cbd7 service nova] Creating event network-vif-plugged:444c688b-f5b5-4ead-ab50-adf37780b912 for instance 026f3741-3da5-4073-b43d-dc925ac1b047 on hv-cinder-84290 Sep 05 14:36:42.397860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-079b345c-bd70-4a84-be22-590b98282eeb req-b8ac8de6-3241-4b81-83ea-3ef84801cbd7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049314 Sep 05 14:36:42.402529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 169/351] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:36:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:36:42.538471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:42.540641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:42.547594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:42.548410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:42.549272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:42.550718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:42.551396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:42.552270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:42.718528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:42.727923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0d7ab89d-0c0e-4df4-95b0-0823215a3f98 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.195333 Sep 05 14:36:42.731118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 183/352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:42 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:43.131346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:43.132037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:43.139736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:43.140436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:43.140864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:43.141944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:43.142439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:43.142944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:43.288523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:43.297687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6546ccdc-0fad-4449-a540-a0177e13222c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1515 microversion: 2.1 time: 0.170107 Sep 05 14:36:43.298262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 170/353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:43 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:43.753988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:43.755229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:43.761711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:43.762367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:43.763001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:43.763822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:43.764427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:43.764880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:43.903192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:43.917330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4d13e343-16ce-4973-a2d9-4aa180435485 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.168246 Sep 05 14:36:43.918027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 184/354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:43 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:44.941868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:44.942462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:44.948572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:44.949050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:44.949484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:44.950169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:44.950649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:44.951207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:45.096365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:45.104021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-adf609f6-9ac7-4bde-bdeb-3aa062392309 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1313 microversion: 2.1 time: 0.167301 Sep 05 14:36:45.104574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 171/355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:44 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:46.128459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:46.128459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:46.134478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:46.135028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:46.135469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:46.136248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:46.136682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:46.137111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:46.270943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-db888c4f-60cd-4673-aecb-5debf8f5bb1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'create', calling method: .version_select at 0x7fb1916cc940>, body: {"keypair": {"name": "tempest-keypair-233443179", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBELhw9Ozz6L+U8S1KspBNeZjQ4ieshc47Gjz5QZMP+XBGjVHnrh8qA0hojbR6ngQynSpp1Rjkp38S5GgFyq0wjXl2wAWRf264Td6rg92w3/w4LYxrwClAQbxEBJFk8ELA=="}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:46.287538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:46.293097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-db888c4f-60cd-4673-aecb-5debf8f5bb1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for project 2af009055e3b4bdda73a770242253b0d. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:36:46.301100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-13a98065-1950-44ff-aa0d-08c67cf87c9f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1496 microversion: 2.1 time: 0.173042 Sep 05 14:36:46.301271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-db888c4f-60cd-4673-aecb-5debf8f5bb1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for user 9136f02e6c664f27b3f4fd35475f0eea and project 2af009055e3b4bdda73a770242253b0d. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:36:46.312378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 185/356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:46 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1496 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:46.415248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-db888c4f-60cd-4673-aecb-5debf8f5bb1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.148092 Sep 05 14:36:46.416299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 172/357] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:36:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:36:49.059176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1142107827", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5252f8af-c73a-406a-9ef0-2603b8718d5e"}], "security_groups": [{"name": "tempest-securitygroup--271298712"}], "key_name": "tempest-keypair-233443179", "user_data": "}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:49.068007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:49.164425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] validate_networks() for [('5252f8af-c73a-406a-9ef0-2603b8718d5e', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:36:49.623468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:36:49.623894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:36:49.624371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:36:49.624805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:36:49.625268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:36:49.644355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:49.644850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:49.645305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:49.646009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:49.646476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:49.653952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:49.667962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for project 2af009055e3b4bdda73a770242253b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:36:49.672670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Getting quotas for user 9136f02e6c664f27b3f4fd35475f0eea and project 2af009055e3b4bdda73a770242253b0d. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:36:49.684677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:36:49.686986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:36:49.856387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-87c98e97-fcfe-4086-b973-d0c60ff9d82f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.801535 Sep 05 14:36:49.857146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 186/358] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:36:49 2022] POST /compute/v2.1/servers => generated 408 bytes in 803 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:36:49.869907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-58375331-591e-4b3d-9fd9-6994045745e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:49.870896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-58375331-591e-4b3d-9fd9-6994045745e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:49.929183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-58375331-591e-4b3d-9fd9-6994045745e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:49.937220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-58375331-591e-4b3d-9fd9-6994045745e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1245 microversion: 2.1 time: 0.072808 Sep 05 14:36:49.937886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 173/359] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1245 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:50.961808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:50.962569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:50.971983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:50.972478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:50.972913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:50.973608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:50.974062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:50.974481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:51.061468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:51.070452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e9982629-b0d7-40b0-a660-e95d15459fb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1249 microversion: 2.1 time: 0.113083 Sep 05 14:36:51.071708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 187/360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1249 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:51.608409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:51.608409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:51.620532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:51.621025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:51.621455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:51.626638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:51.627219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:51.627725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:51.661924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:36:52.053497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1299eb68-c3e0-4e4f-8218-7c78a69ccf85 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "DELETE /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 204 len: 0 microversion: 2.1 time: 0.454236 Sep 05 14:36:52.057488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 174/361] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:36:51 2022] DELETE /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:36:52.063623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:52.064236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:52.074445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:52.075212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:52.075943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:52.077044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:52.077500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:52.078281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:52.101599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:52.102361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:52.108878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:52.110115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:52.110717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:52.111755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:52.112366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:52.112945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:52.208148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:52.217791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ead80fdc-e737-4783-89c0-348c5daca74e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1297 microversion: 2.1 time: 0.123502 Sep 05 14:36:52.227938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 175/362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1297 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:52.288342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:52.298508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7fc68af-fcee-40dc-a09e-e2146ec1f292 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1502 microversion: 2.1 time: 0.239515 Sep 05 14:36:52.299539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 188/363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:52 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1502 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:53.248770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:53.250724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:53.261467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:53.263287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:53.264312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:53.265222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:53.266909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:53.267902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:53.321831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:53.322443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:53.333063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:53.333569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:53.335213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:53.335899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:53.336364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:53.336796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:53.361297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:53.383104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9aead80f-fa40-4804-8dff-3c45c04a445d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1297 microversion: 2.1 time: 0.131397 Sep 05 14:36:53.383104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 176/364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1297 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:53.530282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:53.538602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1ab5abe-d041-4fb6-81c6-9e63fd338e41 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1502 microversion: 2.1 time: 0.220834 Sep 05 14:36:53.543677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 189/365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:53 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1502 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:54.397307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:54.398020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:54.400417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:54.405405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:54.405888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:54.406361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:54.407303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:54.407750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:54.418329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:54.418329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:36:54.489317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:54.500741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c01d732f-384b-4ce1-90b9-204c30a8cd6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1305 microversion: 2.1 time: 0.107175 Sep 05 14:36:54.501616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 177/366] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1305 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:54.565738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:54.566374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:54.572505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:54.572977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:54.573400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:54.574074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:54.574518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:54.574965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:55.040580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:55.049069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-903e8f49-e362-44e3-a8c4-12f2623f8732 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1502 microversion: 2.1 time: 0.487397 Sep 05 14:36:55.049862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 190/367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:54 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1502 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:55.531780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:55.531780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:55.540646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:55.542213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:55.543603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:55.544565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:55.545231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:55.545825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:55.615428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-ad5b51e6-0bb3-426c-98bf-5e763871a5fc req-0171bfd4-da4b-4d02-b52b-a7192db5b24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "026f3741-3da5-4073-b43d-dc925ac1b047", "name": "network-vif-deleted", "tag": "444c688b-f5b5-4ead-ab50-adf37780b912"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:55.625726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ad5b51e6-0bb3-426c-98bf-5e763871a5fc req-0171bfd4-da4b-4d02-b52b-a7192db5b24e service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:55.626203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ad5b51e6-0bb3-426c-98bf-5e763871a5fc req-0171bfd4-da4b-4d02-b52b-a7192db5b24e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:55.628090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ad5b51e6-0bb3-426c-98bf-5e763871a5fc req-0171bfd4-da4b-4d02-b52b-a7192db5b24e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:55.645163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-ad5b51e6-0bb3-426c-98bf-5e763871a5fc req-0171bfd4-da4b-4d02-b52b-a7192db5b24e service nova] Creating event network-vif-deleted:444c688b-f5b5-4ead-ab50-adf37780b912 for instance 026f3741-3da5-4073-b43d-dc925ac1b047 on hv-cinder-84290 Sep 05 14:36:55.652649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-ad5b51e6-0bb3-426c-98bf-5e763871a5fc req-0171bfd4-da4b-4d02-b52b-a7192db5b24e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040803 Sep 05 14:36:55.654045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 191/368] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:36:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:36:55.671195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:55.683362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7596829-8782-4808-81e1-ece52c2822ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1303 microversion: 2.1 time: 0.159941 Sep 05 14:36:55.685151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 178/369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1303 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:56.073629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:56.074669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:56.088937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:56.089656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:56.090260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:56.092075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:56.092711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:56.094597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:56.148703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:56.149911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:56.150352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:56.150839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lazy-loading 'fault' on Instance uuid 026f3741-3da5-4073-b43d-dc925ac1b047 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:36:56.206348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:56.214463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-78b09100-5cb6-4d71-8059-a11d42a09f6f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1303 microversion: 2.1 time: 0.145650 Sep 05 14:36:56.216487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 192/370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:56 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1303 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:56.709407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:56.710113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:56.717598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:56.718151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:56.718750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:56.719569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:56.720020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:56.720439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:56.979406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:56.987187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e1e2075e-8d13-4e28-a9d9-75efaf9b48d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.282269 Sep 05 14:36:56.987829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 179/371] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:57.239482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:57.240766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:57.247492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:57.248366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:57.249075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:57.250532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:57.251061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:57.251635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:57.298780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:57.299457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:57.300147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:57.300633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lazy-loading 'fault' on Instance uuid 026f3741-3da5-4073-b43d-dc925ac1b047 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:36:57.327230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-42bf2811-3f55-4889-99f6-be063cfa7e61 req-4fd1b9fb-1cf0-47a7-8d29-87e2f6da1749 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:57.338607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-42bf2811-3f55-4889-99f6-be063cfa7e61 req-4fd1b9fb-1cf0-47a7-8d29-87e2f6da1749 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:57.341908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-42bf2811-3f55-4889-99f6-be063cfa7e61 req-4fd1b9fb-1cf0-47a7-8d29-87e2f6da1749 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:57.349590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-42bf2811-3f55-4889-99f6-be063cfa7e61 req-4fd1b9fb-1cf0-47a7-8d29-87e2f6da1749 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:57.359914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-42bf2811-3f55-4889-99f6-be063cfa7e61 req-4fd1b9fb-1cf0-47a7-8d29-87e2f6da1749 service nova] Creating event network-changed:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 14:36:57.365404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-42bf2811-3f55-4889-99f6-be063cfa7e61 req-4fd1b9fb-1cf0-47a7-8d29-87e2f6da1749 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041406 Sep 05 14:36:57.366151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 180/372] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:36:57.367734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:57.374893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9758ddba-c769-476a-93db-b2526e5ffed8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 200 len: 1303 microversion: 2.1 time: 0.139241 Sep 05 14:36:57.375467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 193/373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:57 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:36:58.014129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:58.022468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:58.029239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:58.029733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:58.033794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:58.034566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:58.035063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:58.035497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:58.303225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:58.317744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2fed3b5f-466f-4cca-bb61-8a435a08f0f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.309921 Sep 05 14:36:58.318325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 181/374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:58.400151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:58.400757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 026f3741-3da5-4073-b43d-dc925ac1b047] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:58.407437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:58.407944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:58.408292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:58.409030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:58.409476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:58.409891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:58.424542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] HTTP exception thrown: Instance 026f3741-3da5-4073-b43d-dc925ac1b047 could not be found. Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Request method failure captured: Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 HTTP/1.1 Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgli9SodOZ-3MHEjIYjF_W2j-dGDgXbFaJMCv9InvsVfZAN0Mh5VHbvfe6tonEaZY2WAWjOrb9E2Es0d_hQxPhY7VBT_w_a3lkPWvWiNdCrqrtkmULVTerVXnF15KRCLdh5hxbR2lmXWs3RqUMCjQSPIuuNz-J-qVFoajSbSSZSekNk Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: fc60ee38517541b8bc153807f5332011 Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesActionsTest-526893003 Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:36:58.426509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc60ee38517541b8bc153807f5332011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fc60ee38517541b8bc153807f5332011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc60ee38517541b8bc153807f5332011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fc60ee38517541b8bc153807f5332011"}]}] Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesActionsTest-526893003 Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: fc60ee38517541b8bc153807f5332011 Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesActionsTest-526893003 Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesActionsTest-526893003-project Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: e8429576e286422cb09591897e82cd69 Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesActionsTest-526893003-project Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 026f3741-3da5-4073-b43d-dc925ac1b047 could not be found. Sep 05 14:36:58.428102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '026f3741-3da5-4073-b43d-dc925ac1b047'} Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 026f3741-3da5-4073-b43d-dc925ac1b047 could not be found. Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:36:58.428983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 026f3741-3da5-4073-b43d-dc925ac1b047 could not be found. Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 026f3741-3da5-4073-b43d-dc925ac1b047 could not be found. Sep 05 14:36:58.430506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:36:58.432921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Returning 404 to user: Instance 026f3741-3da5-4073-b43d-dc925ac1b047 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:36:58.433922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b90a091c-329c-47e4-bd7a-337ca7789f3a tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047" status: 404 len: 111 microversion: 2.1 time: 0.037624 Sep 05 14:36:58.438270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 194/375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:58 2022] GET /compute/v2.1/servers/026f3741-3da5-4073-b43d-dc925ac1b047 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:36:58.544544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1901644200", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "networks": [{"uuid": "ebaa9a3b-70be-4d21-ad3d-72a6b0dd80da"}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:36:58.619729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] validate_networks() for [('ebaa9a3b-70be-4d21-ad3d-72a6b0dd80da', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:36:59.024154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:36:59.024720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:36:59.024993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:36:59.025404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:36:59.025820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:36:59.035405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:59.035960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:59.036466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:59.037298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:59.038448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:59.038932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:59.059018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Getting quotas for project fc60ee38517541b8bc153807f5332011. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:36:59.062125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Getting quotas for user e8429576e286422cb09591897e82cd69 and project fc60ee38517541b8bc153807f5332011. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:36:59.076683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:36:59.081152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:36:59.210509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8e338edb-9b43-41d9-91cd-ac86b6fe0bfa tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.669713 Sep 05 14:36:59.211727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 182/376] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:36:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 671 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:36:59.222816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-856618d8-446d-457e-af3d-1f16c5741e3f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:59.224181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-856618d8-446d-457e-af3d-1f16c5741e3f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:59.287971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-856618d8-446d-457e-af3d-1f16c5741e3f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:59.296278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-856618d8-446d-457e-af3d-1f16c5741e3f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1214 microversion: 2.1 time: 0.077228 Sep 05 14:36:59.296930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 195/377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:59 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:36:59.341630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:36:59.342736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:36:59.350970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:59.351498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:59.351945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:59.352640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:36:59.353144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:36:59.353802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:36:59.517501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:36:59.527602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aabc50cf-c196-484c-b64e-525996c5f8b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.190519 Sep 05 14:36:59.528611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 183/378] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:36:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:00.320293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:00.320989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:00.324890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:00.329505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:00.330433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:00.331177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:00.332756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:00.333485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:00.334068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:00.423574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:00.431231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c30b6a78-b6ab-4c33-9063-909a685e7095 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1218 microversion: 2.1 time: 0.116036 Sep 05 14:37:00.431973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 196/379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:00 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1218 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:00.550940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:00.552234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:00.560078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:00.560892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:00.561570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:00.563582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:00.564691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:00.565515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:00.731301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:00.742460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cb2bc6a1-6212-4ddf-b5dd-5ee64fecf606 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.195950 Sep 05 14:37:00.744954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 184/380] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:01.454593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:01.455815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:01.462098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:01.462574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:01.463211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:01.463908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:01.464639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:01.465071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:01.537425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:01.545145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9bf7ce8a-3868-4a24-8ce0-9caef6b0ce63 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1218 microversion: 2.1 time: 0.094804 Sep 05 14:37:01.548550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 197/381] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:01 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:01.773174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:01.773856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:01.780553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:01.781586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:01.782058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:01.787875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:01.787875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:01.787875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:01.939471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:01.946982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-229ae38c-ac1d-471a-ae57-d17b8746c621 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.182734 Sep 05 14:37:01.947543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 185/382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:37:02.569170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:02.570446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:02.578709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:02.579429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:02.582897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:02.582897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:02.582897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:02.582897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:02.664471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:02.672120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dc60a24c-eba2-4af7-b3c2-daefe96f5997 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1266 microversion: 2.1 time: 0.106856 Sep 05 14:37:02.672687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 198/383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:02 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1266 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:37:02.970326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:02.971535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:02.978090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:02.978575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:02.979039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:02.980099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:02.980704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:02.981265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:03.138496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:03.148907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ddc57e67-1766-498d-b344-55218bc4a624 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.182623 Sep 05 14:37:03.149073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 186/384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:03.694402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:03.695124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:03.708360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:03.708857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:03.709289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:03.716892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:03.721275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:03.721275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:03.830009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:03.832203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:03.839525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8d4c48d7-49c2-4cc9-9206-6c020d019044 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1272 microversion: 2.1 time: 0.149194 Sep 05 14:37:03.859429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 199/385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:03 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1272 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:04.174598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:04.175871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:04.182856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:04.183638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:04.184310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:04.185029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:04.186200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:04.186825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:04.322046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:04.330731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ba64fb7-ec03-4215-aa6f-b3224a58c5b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.161139 Sep 05 14:37:04.331620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 187/386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:04.863738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:04.864384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:04.870524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:04.871003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:04.872058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:04.872762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:04.873251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:04.873676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:05.137291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:05.145565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7ccc5be-7674-4d0e-82ec-8be630058411 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.286313 Sep 05 14:37:05.146133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 200/387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:04 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:05.354248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:05.355640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:05.362612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:05.363134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:05.363861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:05.364774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:05.365522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:05.365852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:05.391559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-6a1eb57b-613d-4301-9294-24be10ba78bb req-78c91b0a-006b-44a8-85b7-0cc9399d5d96 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0711caad-6d34-4c58-b90f-8d6aaf41cdf3", "tag": "7bf16af9-f1cc-4881-beba-48a1a30183ab"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:37:05.409776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-6a1eb57b-613d-4301-9294-24be10ba78bb req-78c91b0a-006b-44a8-85b7-0cc9399d5d96 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:05.410608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-6a1eb57b-613d-4301-9294-24be10ba78bb req-78c91b0a-006b-44a8-85b7-0cc9399d5d96 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:05.411285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-6a1eb57b-613d-4301-9294-24be10ba78bb req-78c91b0a-006b-44a8-85b7-0cc9399d5d96 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:05.427438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-6a1eb57b-613d-4301-9294-24be10ba78bb req-78c91b0a-006b-44a8-85b7-0cc9399d5d96 service nova] Creating event network-changed:7bf16af9-f1cc-4881-beba-48a1a30183ab for instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 on hv-cinder-84290 Sep 05 14:37:05.434562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-6a1eb57b-613d-4301-9294-24be10ba78bb req-78c91b0a-006b-44a8-85b7-0cc9399d5d96 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055486 Sep 05 14:37:05.435636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 201/388] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:37:05.565548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-56e90cca-d5e4-46a1-a705-dd3a4b25f97d req-9ab2f688-a7d0-434d-9a42-ccdd23897044 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "name": "network-vif-plugged", "status": "completed", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:37:05.576095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-56e90cca-d5e4-46a1-a705-dd3a4b25f97d req-9ab2f688-a7d0-434d-9a42-ccdd23897044 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:05.576095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-56e90cca-d5e4-46a1-a705-dd3a4b25f97d req-9ab2f688-a7d0-434d-9a42-ccdd23897044 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:05.576674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-56e90cca-d5e4-46a1-a705-dd3a4b25f97d req-9ab2f688-a7d0-434d-9a42-ccdd23897044 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:05.588894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-56e90cca-d5e4-46a1-a705-dd3a4b25f97d req-9ab2f688-a7d0-434d-9a42-ccdd23897044 service nova] Creating event network-vif-plugged:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 14:37:05.594894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-56e90cca-d5e4-46a1-a705-dd3a4b25f97d req-9ab2f688-a7d0-434d-9a42-ccdd23897044 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033407 Sep 05 14:37:05.595514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 202/389] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:37:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:37:05.615756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:05.624047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b742d0d4-5ad9-4974-9a08-5552d6c01263 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.273716 Sep 05 14:37:05.639801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 188/390] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:06.169375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:06.170395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:06.177315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:06.177822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:06.178250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:06.178974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:06.179421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:06.179862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:06.326693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:06.335870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b7ff0815-337b-4406-bacc-633a565c45e1 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.170575 Sep 05 14:37:06.336720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 203/391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:06 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:06.648779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:06.650006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:06.657322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:06.657816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:06.658245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:06.658986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:06.659440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:06.659860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:06.803983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:06.812968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-07479961-d47a-462a-abba-19f70485fb51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.167441 Sep 05 14:37:06.813618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 189/392] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:07.360670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:07.361284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:07.367291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:07.367795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:07.368316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:07.368986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:07.369444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:07.369881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:07.501367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:07.509170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d35b6bc1-d48b-417e-a2c1-753fc8fcd329 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.152508 Sep 05 14:37:07.509734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 204/393] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:07 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:07.841800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:07.842439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:07.849030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:07.849467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:07.855642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:07.855642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:07.855642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:07.855642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:08.014181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:08.022879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-19832919-4533-41de-96d0-b1753311b07f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.185314 Sep 05 14:37:08.023450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 190/394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:08.533064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:08.533685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:08.540498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:08.540990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:08.541426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:08.542127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:08.542581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:08.543033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:08.685462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:08.693062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-46a6082e-833e-4b3c-ab66-81e5b10b276b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.164600 Sep 05 14:37:08.693619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 205/395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:08 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:09.046171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:09.047485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:09.049861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:09.054540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:09.055053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:09.055669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:09.056427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:09.056879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:09.057299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:09.074749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=12 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:09.184815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:09.192935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7ac0bca-0eb2-4f09-a04c-d94cc4739d94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.150533 Sep 05 14:37:09.193425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 191/396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:09.717783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:09.718438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:09.720401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=8 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:09.725365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:09.725852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:09.726295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:09.727039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:09.727506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:09.727930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:09.857652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:09.865471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f02057d4-4ece-4609-981c-83285b56d4a5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.151976 Sep 05 14:37:09.866032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 206/397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:09 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:10.215711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:10.216590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:10.224619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:10.225102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:10.225539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:10.226232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:10.226689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:10.227194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:10.363381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:10.370775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4c13a65-f451-468a-8a73-784436cde400 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.158926 Sep 05 14:37:10.371357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 192/398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:10.888536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:10.889167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:10.896008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:10.896485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:10.910371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:10.910371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:10.910371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:10.910371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:11.035607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:11.044436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-46d0a42a-44ff-4668-83bc-abc2228c2a7b tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.159650 Sep 05 14:37:11.045018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 207/399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:10 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:11.393211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:11.393813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:11.400118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:11.409813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:11.409813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:11.409813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:11.409813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:11.410197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:11.531783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:11.539642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-009db080-366f-4b28-b641-181f67010eab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1370 microversion: 2.1 time: 0.150280 Sep 05 14:37:11.540220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 193/400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1370 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:12.067926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:12.068530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:12.074458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:12.074987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:12.075425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:12.076110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:12.076563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:12.076983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:12.210592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:12.219344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3a2e3443-2768-4ce1-b3a9-ad4d2efcc6d7 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.155284 Sep 05 14:37:12.219907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 208/401] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:12 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:37:12.561619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:12.562186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:12.568905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:12.569389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:12.569822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:12.570513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:12.571023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:12.571450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:12.710730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:12.719497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b6f9785b-4c7a-49e0-b739-287d8d4f06a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1565 microversion: 2.1 time: 0.161801 Sep 05 14:37:12.720490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 194/402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1565 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:12.742347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:12.742973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:12.749298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:12.750311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:12.750749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:12.751506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:12.751976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:12.752382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:12.835738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ddf54c0-856e-4f53-8cf8-0471149ef580 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097275 Sep 05 14:37:12.845028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 209/403] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 14:37:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:37:13.243365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:13.246291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:13.253381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:13.253871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:13.254327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:13.255069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:13.255657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:13.255998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:13.260178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:13.463600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:13.473091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2d7fb63a-859e-4564-94d6-9c3d278aaec5 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.233823 Sep 05 14:37:13.474862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 195/404] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:13 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:14.177494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-511074f8-2d6e-4a36-abd6-fc26a4d6d387 req-f00995b5-3032-4ddd-9374-8383a5234023 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:37:14.187764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-511074f8-2d6e-4a36-abd6-fc26a4d6d387 req-f00995b5-3032-4ddd-9374-8383a5234023 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:14.188328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-511074f8-2d6e-4a36-abd6-fc26a4d6d387 req-f00995b5-3032-4ddd-9374-8383a5234023 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:14.189074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-511074f8-2d6e-4a36-abd6-fc26a4d6d387 req-f00995b5-3032-4ddd-9374-8383a5234023 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:14.201395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-511074f8-2d6e-4a36-abd6-fc26a4d6d387 req-f00995b5-3032-4ddd-9374-8383a5234023 service nova] Creating event network-changed:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 14:37:14.206966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-511074f8-2d6e-4a36-abd6-fc26a4d6d387 req-f00995b5-3032-4ddd-9374-8383a5234023 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033282 Sep 05 14:37:14.207612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 210/405] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:37:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:37:14.501254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:14.501963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:14.509340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:14.509738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:14.510166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:14.510935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:14.511694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:14.512391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:14.669706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:14.679568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ffc2c97-1cfa-42bf-8a77-a6587d05cfc6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.185834 Sep 05 14:37:14.680148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 196/406] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:14 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:15.706354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:15.708118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:15.729782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:15.730734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:15.731647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:15.732801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:15.733862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:15.735239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:15.976523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:15.987269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-74b832de-d640-4c06-ac66-0e1d44d86abf tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.285595 Sep 05 14:37:15.987841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 211/407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:15 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:37:16.296017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-0f99eac8-c1a6-492b-874a-fb294a8e6f8d req-8bb5874f-708d-4fcd-a2a4-c49429a34aed service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0711caad-6d34-4c58-b90f-8d6aaf41cdf3", "name": "network-vif-plugged", "status": "completed", "tag": "7bf16af9-f1cc-4881-beba-48a1a30183ab"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:37:16.305873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0f99eac8-c1a6-492b-874a-fb294a8e6f8d req-8bb5874f-708d-4fcd-a2a4-c49429a34aed service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:16.306344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0f99eac8-c1a6-492b-874a-fb294a8e6f8d req-8bb5874f-708d-4fcd-a2a4-c49429a34aed service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:16.306766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0f99eac8-c1a6-492b-874a-fb294a8e6f8d req-8bb5874f-708d-4fcd-a2a4-c49429a34aed service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:16.318934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-0f99eac8-c1a6-492b-874a-fb294a8e6f8d req-8bb5874f-708d-4fcd-a2a4-c49429a34aed service nova] Creating event network-vif-plugged:7bf16af9-f1cc-4881-beba-48a1a30183ab for instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 on hv-cinder-84290 Sep 05 14:37:16.326149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-0f99eac8-c1a6-492b-874a-fb294a8e6f8d req-8bb5874f-708d-4fcd-a2a4-c49429a34aed service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033782 Sep 05 14:37:16.326709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 197/408] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:37:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:37:17.010296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:17.011562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:17.017521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:17.018004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:17.018434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:17.019146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:17.019592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:17.020010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:17.162652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:17.173176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ff82d96-cf56-422f-9f4b-6a8b7f66d748 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.166464 Sep 05 14:37:17.174197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 212/409] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:17 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:18.197975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:18.200855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:18.207989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:18.210029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:18.210029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:18.210029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:18.210401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:18.210692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:18.346521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:18.354681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d45b4779-4d65-4fc8-abb5-0b7463b778f8 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.161478 Sep 05 14:37:18.355295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 198/410] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:18 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:19.378008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:19.378614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:19.384559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:19.385042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:19.385470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:19.386144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:19.386586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:19.387037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:19.535662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:19.543455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ccfc4c3e-4389-4b5e-8825-e8d4b818f240 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1314 microversion: 2.1 time: 0.169983 Sep 05 14:37:19.544016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 213/411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:19 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:20.565878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:20.566487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:20.573314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:20.573611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:20.574068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:20.574766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:20.575248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:20.575677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:20.711257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:20.720648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e8f27a46-624c-48c9-bb4e-eb91101aea77 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1498 microversion: 2.1 time: 0.159192 Sep 05 14:37:20.721827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 199/412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:20 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1498 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:27.961912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:27.962414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:27.964650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:27.969945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:27.970428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:27.970990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:27.971650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:27.971995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:27.972418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:27.998822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:37:28.344712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5f7d4339-475b-4a6b-ae2a-d108b6616870 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 204 len: 0 microversion: 2.1 time: 0.386509 Sep 05 14:37:28.345950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 214/413] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:37:27 2022] DELETE /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:37:28.355859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:28.356903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:28.359448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=57,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:28.366488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:28.367297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:28.367933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:28.368442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:28.368895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:28.369318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:28.508201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:28.516760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b490745a-ee3d-4ee8-a69a-9f105306a983 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.166587 Sep 05 14:37:28.517330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 200/414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:28 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:29.540915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:29.541607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:29.547535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:29.548019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:29.548454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:29.549142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:29.549595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:29.550017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:29.677385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:29.685480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70662262-6621-4189-ad24-5da00a106813 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.148801 Sep 05 14:37:29.686037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 215/415] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:29 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:30.707539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:30.708084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:30.714506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:30.715030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:30.715464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:30.716145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:30.716862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:30.717284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:30.845067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:30.852619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-47c6114c-ebc5-4a31-ac18-a5a898a63d8d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.149010 Sep 05 14:37:30.856403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 201/416] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:30 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:31.878543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:31.879178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:31.885107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:31.885587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:31.886038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:31.886706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:31.887261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:31.887686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:32.014379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:32.022116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a066493-b9a4-4437-ab1c-ec72c19ecb03 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.148048 Sep 05 14:37:32.022674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 216/417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:31 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:33.044754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:33.045353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:33.051513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:33.051993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:33.052420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:33.053103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:33.053549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:33.053963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:33.184857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:33.193521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-afc9e41d-361a-450d-aa71-3d8a0678f69f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.152478 Sep 05 14:37:33.194140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 202/418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:33 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:34.217341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:34.217982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:34.224365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:34.224843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:34.225271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:34.225942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:34.226393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:34.226856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:34.229430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:37:34.354624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:34.362646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e346464c-9ae3-4aa0-b7ce-221fd4253a1f tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.149516 Sep 05 14:37:34.363238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 217/419] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:34 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:35.384956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:35.385486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:35.391909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:35.392392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:35.392884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:35.393610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:35.394121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:35.394545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:35.523329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:35.531554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f46e1785-7248-4773-a1d4-0affe9298612 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.150015 Sep 05 14:37:35.532118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 203/420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:35 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:36.553547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:36.554176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:36.560476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:36.560956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:36.561389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:36.562639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:36.563127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:36.563547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:36.698189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:36.705792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-abbe3418-f246-4980-99fe-52d0ea4788c2 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1504 microversion: 2.1 time: 0.156157 Sep 05 14:37:36.706349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 218/421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:36 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:37.720048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-b9ec66a3-091e-4dc1-a2f9-e9c14e943644 req-f7ed5cfd-f64d-4545-9bb3-a81e33e77ece service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0711caad-6d34-4c58-b90f-8d6aaf41cdf3", "name": "network-vif-deleted", "tag": "7bf16af9-f1cc-4881-beba-48a1a30183ab"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:37:37.729916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b9ec66a3-091e-4dc1-a2f9-e9c14e943644 req-f7ed5cfd-f64d-4545-9bb3-a81e33e77ece service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:37.730135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:37.730582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b9ec66a3-091e-4dc1-a2f9-e9c14e943644 req-f7ed5cfd-f64d-4545-9bb3-a81e33e77ece service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:37.730669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:37.730933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b9ec66a3-091e-4dc1-a2f9-e9c14e943644 req-f7ed5cfd-f64d-4545-9bb3-a81e33e77ece service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:37.739304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:37.739818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:37.740317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:37.741149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:37.741626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:37.742042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:37.742948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-b9ec66a3-091e-4dc1-a2f9-e9c14e943644 req-f7ed5cfd-f64d-4545-9bb3-a81e33e77ece service nova] Creating event network-vif-deleted:7bf16af9-f1cc-4881-beba-48a1a30183ab for instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 on hv-cinder-84290 Sep 05 14:37:37.748053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-b9ec66a3-091e-4dc1-a2f9-e9c14e943644 req-f7ed5cfd-f64d-4545-9bb3-a81e33e77ece service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032352 Sep 05 14:37:37.748648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 204/422] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:37:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:37:37.806822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:37.814629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-18536219-bf58-4a61-bc20-dde894217366 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1462 microversion: 2.1 time: 0.088982 Sep 05 14:37:37.815328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 219/423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:37 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1462 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:38.840240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:38.840939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:38.847322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:38.847802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:38.848238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:38.848924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:38.849380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:38.849831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:38.911447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:38.919048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2baeb998-8a7f-48b2-8a23-8145fb97c6f6 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1299 microversion: 2.1 time: 0.083532 Sep 05 14:37:38.919598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 205/424] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:38 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:39.941275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:39.941886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:39.947910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:39.948394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:39.948821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:39.949506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:39.949956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:39.950369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:40.013773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:40.021876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c649af7b-8cd9-495d-bac8-b381a91bc01c tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1299 microversion: 2.1 time: 0.084396 Sep 05 14:37:40.022439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 220/425] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:39 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:41.045532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:41.046676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:41.053130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:41.053605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:41.054084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:41.054760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:41.055233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:41.055650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:41.117009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:41.125190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cebc532b-1755-44c7-a4dd-71a8686f9b60 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1299 microversion: 2.1 time: 0.083629 Sep 05 14:37:41.125741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 206/426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:41 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1299 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:42.081961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:42.082500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:42.084737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:37:42.084892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:37:42 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/ips (ip 10.222.0.15) !!! Sep 05 14:37:42.090776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:42.091283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:42.091977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:42.092669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:42.093617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:42.094038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:42.120297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ed0c503-4aba-4b2f-8ed4-0fbe6eb7d1bf tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/ips" status: 200 len: 149 microversion: 2.1 time: 0.042265 Sep 05 14:37:42.120862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 221/427] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:37:42 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:37:42.147834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:42.148596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:42.154966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:42.155958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:42.156392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:42.157118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:42.157557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:42.158025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:42.221077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:42.228635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-852663fa-63fc-4cc3-9ddb-1c750a5d008d tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1299 microversion: 2.1 time: 0.084688 Sep 05 14:37:42.229200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 207/428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:42 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:43.250772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:43.251407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:43.257286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:43.257770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:43.258212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:43.258933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:43.259389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:43.259811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:43.290386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:43.290926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:43.291365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:43.291841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lazy-loading 'fault' on Instance uuid 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:37:43.331909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8429576e286422cb09591897e82cd69', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fc60ee38517541b8bc153807f5332011', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:37:43.339367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-de8bd5e7-c5d8-4bd0-87f0-d046744e9225 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 200 len: 1304 microversion: 2.1 time: 0.092444 Sep 05 14:37:43.339919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 222/429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:43 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 1304 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:37:44.363356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:37:44.364003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] [instance: 0711caad-6d34-4c58-b90f-8d6aaf41cdf3] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:44.369847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:44.370431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:44.370898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:44.371594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:44.372052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:44.372485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:44.385853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] HTTP exception thrown: Instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 could not be found. Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Request method failure captured: Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 HTTP/1.1 Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgli9SodOZ-3MHEjIYjF_W2j-dGDgXbFaJMCv9InvsVfZAN0Mh5VHbvfe6tonEaZY2WAWjOrb9E2Es0d_hQxPhY7VBT_w_a3lkPWvWiNdCrqrtkmULVTerVXnF15KRCLdh5hxbR2lmXWs3RqUMCjQSPIuuNz-J-qVFoajSbSSZSekNk Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: fc60ee38517541b8bc153807f5332011 Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesActionsTest-526893003 Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:37:44.387505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc60ee38517541b8bc153807f5332011"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/fc60ee38517541b8bc153807f5332011"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/fc60ee38517541b8bc153807f5332011"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_fc60ee38517541b8bc153807f5332011"}]}] Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesActionsTest-526893003 Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: fc60ee38517541b8bc153807f5332011 Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesActionsTest-526893003 Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesActionsTest-526893003-project Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: e8429576e286422cb09591897e82cd69 Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesActionsTest-526893003-project Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 could not be found. Sep 05 14:37:44.388926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '0711caad-6d34-4c58-b90f-8d6aaf41cdf3'} Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 could not be found. Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:37:44.389839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 could not be found. Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 could not be found. Sep 05 14:37:44.391651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:37:44.392742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] Returning 404 to user: Instance 0711caad-6d34-4c58-b90f-8d6aaf41cdf3 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:37:44.392742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a9c25b7e-9b58-40d5-9686-02e6d88cc122 tempest-VolumesActionsTest-526893003 tempest-VolumesActionsTest-526893003-project] 10.222.0.15 "GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3" status: 404 len: 111 microversion: 2.1 time: 0.030145 Sep 05 14:37:44.392742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 208/430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:37:44 2022] GET /compute/v2.1/servers/0711caad-6d34-4c58-b90f-8d6aaf41cdf3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:37:45.923763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "412c19b3-8b68-476e-8b33-f673f20ba56f"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:37:45.926043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:37:45.932058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:45.932542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:45.933125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:45.934103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:37:45.934407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:37:45.935081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:37:50.404195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70dcc83a-350e-4b6e-af4c-2e6ba05c30c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.484802 Sep 05 14:37:50.404835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 223/431] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:37:45 2022] POST /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments => generated 194 bytes in 4486 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:05.579626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0dd99947-1cd8-4395-8d43-1fa8f2757276 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: .version_select at 0x7fb19157d8b0>, body: {"keypair": {"name": "tempest-keypair-1587200949", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGr+vY4XXmHwoz1fy95s3HzOCKk0L9noHxs+W8vHIoza6jWxwEc0s5ECG5kyUj6wT4G7LWofrPq1LsNwZ6XdDG3vwZGMka9lXR+T3dZGMcfI2rDHK6j83UrhoP6glQl7Ow=="}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:05.597090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=17 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:05.599934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=71 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:05.622921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-0dd99947-1cd8-4395-8d43-1fa8f2757276 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:38:05.632354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-0dd99947-1cd8-4395-8d43-1fa8f2757276 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:38:05.755014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0dd99947-1cd8-4395-8d43-1fa8f2757276 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.189777 Sep 05 14:38:05.763869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 209/432] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:38:05 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:09.531359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:09.531359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:09.533850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1410299610", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b1d20ee-7dc0-477b-93a5-81201fa15bc2"}], "security_groups": [{"name": "tempest-securitygroup--9560125"}], "key_name": "tempest-keypair-1587200949", "user_data": "}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:16.583300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] validate_networks() for [('6b1d20ee-7dc0-477b-93a5-81201fa15bc2', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:38:17.396835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=4 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:17.397692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:17.401916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:17.402623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:17.431903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:17.432865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:17.433660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:17.437282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:17.443429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:17.454563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:17.471709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:38:17.472145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:38:17.472627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:38:17.474599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:38:17.475079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:38:17.478191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6977e079-d308-458b-b8a7-a60cf0952683 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/ips" status: 200 len: 151 microversion: 2.20 time: 0.084097 Sep 05 14:38:17.479315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 210/433] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Sep 5 14:38:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/ips => generated 151 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:38:17.493454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:17.494240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:17.495034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:17.496983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:17.497680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:17.498372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:17.523087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:38:17.528022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:38:17.543939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:38:17.547607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:38:17.731808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c72fa03-4524-407e-8062-83a997e41143 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 399 microversion: 2.1 time: 8.205837 Sep 05 14:38:17.734469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 224/434] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:38:09 2022] POST /compute/v2.1/servers => generated 399 bytes in 8210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:38:17.745340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-395021b1-b6a6-4173-80fb-be63239ba24d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:17.746253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-395021b1-b6a6-4173-80fb-be63239ba24d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:17.906965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-395021b1-b6a6-4173-80fb-be63239ba24d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:17.925306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-395021b1-b6a6-4173-80fb-be63239ba24d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1242 microversion: 2.1 time: 0.184054 Sep 05 14:38:17.925950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 211/435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:17 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1242 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:18.947797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d9e78787-d05f-4ccb-b521-7ac0465abfe8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:18.949607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d9e78787-d05f-4ccb-b521-7ac0465abfe8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:19.019654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d9e78787-d05f-4ccb-b521-7ac0465abfe8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:19.026736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d9e78787-d05f-4ccb-b521-7ac0465abfe8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1242 microversion: 2.1 time: 0.082772 Sep 05 14:38:19.027331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 225/436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:18 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:20.049516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:20.050328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:20.056839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:20.057321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:20.057748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:20.058433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:20.058912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:20.059336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:20.143537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:20.151469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-68cf0a30-d392-46a6-8ec2-de68242094f9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1294 microversion: 2.1 time: 0.105787 Sep 05 14:38:20.152227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 212/437] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:20 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1294 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:21.177917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:21.187434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:21.192364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:21.196832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:21.197505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:21.198400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:21.199209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:21.199792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:21.242385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:21.242955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:21.251155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:21.251649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:21.262101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:21.262101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:21.262101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:21.262101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:21.275691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:21.286240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-47820d7e-eef4-491f-b81f-a9c8b15f2fed tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1302 microversion: 2.1 time: 0.112301 Sep 05 14:38:21.301727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 226/438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:21 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1302 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:21.317185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lazy-loading 'flavor' on Instance uuid 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:38:22.313513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:22.314121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:22.325902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:22.332096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:22.334753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:22.334753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:22.334753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:22.336251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:22.571021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:22.583874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-353711ea-b174-487d-b1ea-e98b77521c97 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.276066 Sep 05 14:38:22.584651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 227/439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:22 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:22.806860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3e4a83c4-f39c-4339-b8d7-cffd60349330 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/action" status: 202 len: 0 microversion: 2.20 time: 1.566170 Sep 05 14:38:22.812362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 213/440] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 5 14:38:21 2022] POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/action => generated 0 bytes in 1574 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 05 14:38:22.817445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:22.818103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:22.828128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:22.832505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:22.833082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:22.834893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:22.835779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:22.836317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:23.058102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:23.073999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:23.077888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:23.086710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b35d4a60-c6c9-4e2e-8baf-c908371bbe8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.273434 Sep 05 14:38:23.087722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 228/441] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:23.305039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-ced5530c-bb53-41da-be87-c4c4b4608191 req-d8620e48-98e2-4f3e-8b1b-fae794efb2cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8135d8b8-fc8e-404c-a3d2-90595028a8bf", "tag": "b6e63722-ab5f-4e8a-a5a1-256e8465473b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:23.381058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-ced5530c-bb53-41da-be87-c4c4b4608191 req-d8620e48-98e2-4f3e-8b1b-fae794efb2cd service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:23.382303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-ced5530c-bb53-41da-be87-c4c4b4608191 req-d8620e48-98e2-4f3e-8b1b-fae794efb2cd service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:23.383062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-ced5530c-bb53-41da-be87-c4c4b4608191 req-d8620e48-98e2-4f3e-8b1b-fae794efb2cd service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:23.401581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-ced5530c-bb53-41da-be87-c4c4b4608191 req-d8620e48-98e2-4f3e-8b1b-fae794efb2cd service nova] Creating event network-changed:b6e63722-ab5f-4e8a-a5a1-256e8465473b for instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf on hv-cinder-84290 Sep 05 14:38:23.408708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-ced5530c-bb53-41da-be87-c4c4b4608191 req-d8620e48-98e2-4f3e-8b1b-fae794efb2cd service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107679 Sep 05 14:38:23.414124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 214/442] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:38:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:38:23.607330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:23.608779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:23.621750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:23.622558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:23.623208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:23.624099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:23.624728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:23.625322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:23.791488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:23.801307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fb6d32a0-5926-4b29-995b-19d3e9543300 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.198304 Sep 05 14:38:23.820715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 229/443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:23 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:24.115381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:24.116074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:24.122217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:24.122695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:24.123158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:24.124345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:24.124800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:24.125222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:24.366490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:24.382313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:24.383904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:24.385139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-beb8b3ec-7fa3-406b-a961-3d69e14b3dd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.274118 Sep 05 14:38:24.386014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 215/444] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:24.831824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:24.832485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:24.851493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:24.851493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:24.851493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:24.851493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:24.851929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:24.851929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:25.082919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:25.096111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7ecc5164-8cbe-4ca8-a9cb-2dcb948b706a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.271508 Sep 05 14:38:25.096695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 230/445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:24 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:25.414389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:25.415631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:25.426506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:25.427308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:25.431783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:25.431783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:25.431783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:25.431783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:25.600914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:25.615605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:25.618212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:25.619658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2831afb0-db9e-4680-881c-8c3b5081475b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.210121 Sep 05 14:38:25.620439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 216/446] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:26.123247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:26.125261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:26.136335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:26.141015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:26.141015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:26.141015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:26.141015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:26.141418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:26.358355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:26.366274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4e28c6f1-51d3-48d8-9933-e75cae020757 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.247968 Sep 05 14:38:26.366865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 231/447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:26 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:26.645685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:26.646290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:26.653498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:26.653986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:26.654524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:26.655229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:26.655689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:26.656118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:26.859232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:26.870600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:26.875259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:26.876492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-312ecb6e-9950-4c6e-aab3-7a4dbde19550 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.234850 Sep 05 14:38:26.877069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 217/448] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:27.390817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:27.392494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:27.398927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:27.399555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:27.400128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:27.400913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:27.401375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:27.401831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:27.508779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:27.540034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:27.541147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-13e69ba3-49b8-473f-99ce-c0a6891f6573 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.154164 Sep 05 14:38:27.541714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 232/449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:27 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:27.901864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:27.902484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:27.909425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:27.909912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:27.918134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:27.918134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:27.918134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:27.918134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:27.929726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:28.056069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:28.065911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:28.079976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:28.079976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e3edff60-fbc9-4a04-882f-39b6ed18fd1e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.171013 Sep 05 14:38:28.079976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 218/450] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:28.564670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:28.565507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:28.573654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:28.574135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:28.574574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:28.575518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:28.576188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:28.576519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:28.732652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:28.741839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aa7d3beb-d6c6-4457-a8b1-026dc996cef4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.181583 Sep 05 14:38:28.742406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 233/451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:28 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:29.103177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:29.104070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:29.111317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:29.112180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:29.113060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:29.114146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:29.114853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:29.115490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:29.276985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:29.289361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:29.292385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:29.293726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-edefb06c-a041-4d8e-b7b2-5eb031472f70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.194963 Sep 05 14:38:29.303192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 219/452] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:29.777056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:29.777705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:29.779752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=8 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:29.785439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:29.786169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:29.786762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:29.787652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:29.788401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:29.788969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:30.289201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:30.290740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9bb5892c-b72f-43cc-b078-875d5466158d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.517574 Sep 05 14:38:30.299213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 234/453] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:29 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:30.321082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:30.327995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:30.333708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:30.334473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:30.335153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:30.336222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:30.337108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:30.337742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:30.562405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:30.590375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:30.597019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:30.599192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8e392637-607e-4089-9f08-e1f62c317fd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.282207 Sep 05 14:38:30.602489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 220/454] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:31.313978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:31.315167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:31.332428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:31.337431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:31.337431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:31.337431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:31.337431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:31.337814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:31.638383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:31.638835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:31.671171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:31.671935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:31.672527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:31.673390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:31.675938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:31.679758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:31.724796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:31.733722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ff53940f-efd0-41f2-a1a2-d27c57e5e628 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.423654 Sep 05 14:38:31.734880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 235/455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:31 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:31.987166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:31.995303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:31.996745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:31.997920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e9042260-de4e-43bf-b4b9-774919332c4a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.364132 Sep 05 14:38:31.998480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 221/456] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:32.766261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:32.767620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:32.792280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:32.803458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:32.803458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:32.803458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:32.803458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:32.803954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:32.941995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:32.950024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cfba91a9-6edd-4b3e-9188-8f2b289f94c3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.189458 Sep 05 14:38:32.950634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 236/457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:32 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:33.028448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:33.029208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:33.036712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:33.037538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:33.038167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:33.039150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:33.039695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:33.040189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:33.184553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:33.193792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:33.195544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:33.198670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1113577c-2e65-4185-b887-4feefdcde7ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.174285 Sep 05 14:38:33.206039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 222/458] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:33.973718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:33.974968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:33.984630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:33.985577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:33.986164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:33.987865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:33.988643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:33.989225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:34.211046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:34.220706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-58cf3726-dbc2-4ce4-ad61-e9292ba3c727 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.250200 Sep 05 14:38:34.220706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 237/459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:33 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:34.225761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:34.226408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:34.236217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:34.236635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:34.237050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:34.240201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:34.240805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:34.242011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:34.286970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a619e99e-22b4-4b92-a7d9-d32d7f043e41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'create', calling method: .version_select at 0x7fb1916b8940>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1349983520", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIR5mwmNj4ipGlZr+EeSa3jGtPnpclDjbIBdoRXkOM3AGf9eIvvU1Tif0jeJ66fuCU2HdMBCaKknugb2t2UIBQ2xFICc4gjdFxVK16s20aIQ3uG51Z77eRdAy9UjcnnUHA=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:34.304105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-a619e99e-22b4-4b92-a7d9-d32d7f043e41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Getting quotas for project e17efecb1ba44e69ac6b076e56ec9603. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:38:34.308138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-a619e99e-22b4-4b92-a7d9-d32d7f043e41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Getting quotas for user 1a2d7c64ad9d44f997333ace9d4e60a1 and project e17efecb1ba44e69ac6b076e56ec9603. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:38:34.385851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a619e99e-22b4-4b92-a7d9-d32d7f043e41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.103069 Sep 05 14:38:34.387887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 238/460] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:38:34 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:34.398932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:34.414387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:34.417994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:34.421513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5c7aea4f-7c97-4444-ba15-17495941758d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.198791 Sep 05 14:38:34.422769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 223/461] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:34.516105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1093804265", "imageRef": "92cd1f48-b23d-43b1-a289-0f8dcbd8330b", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1349983520", "networks": [{"uuid": "0c3c7e73-9a22-4850-9e0b-d51e1dc57537"}]}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:34.583898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] validate_networks() for [('0c3c7e73-9a22-4850-9e0b-d51e1dc57537', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:38:35.119091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:38:35.120676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:38:35.121373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:38:35.121783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:38:35.122197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:38:35.134353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:35.135152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:35.136254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:35.137195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:35.137724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:35.138070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:35.160159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Getting quotas for project e17efecb1ba44e69ac6b076e56ec9603. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:38:35.164257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Getting quotas for user 1a2d7c64ad9d44f997333ace9d4e60a1 and project e17efecb1ba44e69ac6b076e56ec9603. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:38:35.175837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:38:35.178158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92cd1f48-b23d-43b1-a289-0f8dcbd8330b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:38:35.243339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:35.244550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:35.252828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:35.253346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:35.253787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:35.254504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:35.255164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:35.255737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:35.294844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f19a1a76-dc50-4fe4-8553-94f375494a9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.782492 Sep 05 14:38:35.301605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 239/462] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:38:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 790 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:38:35.314261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07dd5b33-acaa-4206-8fea-e06baf1a3485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:35.315136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07dd5b33-acaa-4206-8fea-e06baf1a3485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:35.412215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07dd5b33-acaa-4206-8fea-e06baf1a3485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:35.422072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07dd5b33-acaa-4206-8fea-e06baf1a3485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1259 microversion: 2.1 time: 0.118865 Sep 05 14:38:35.435749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 240/463] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1259 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:35.441284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:35.450926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc5de143-68e0-4bd8-a26c-54942ad7ad17 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.211401 Sep 05 14:38:35.451510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 224/464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:35 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:35.454892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:35.454892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:35.461590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:35.469472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:35.469472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:35.469472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:35.469472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:35.469972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:35.621867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:35.634128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:35.635673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:35.636829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e30007b5-518c-48ed-ac52-ff391e3cdc5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.189670 Sep 05 14:38:35.637837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 241/465] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:36.449955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a368b756-f184-46a6-b733-9a5add0585f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:36.450769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a368b756-f184-46a6-b733-9a5add0585f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:36.474532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:36.475208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:36.487125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:36.487626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:36.488063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:36.488771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:36.489230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:36.489652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:36.556061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a368b756-f184-46a6-b733-9a5add0585f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:36.565918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a368b756-f184-46a6-b733-9a5add0585f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1259 microversion: 2.1 time: 0.124103 Sep 05 14:38:36.580850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 225/466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1259 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:36.664129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:36.664952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:36.672195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:36.672947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:36.673599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:36.674499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:36.675164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:36.675812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:36.707536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:36.715895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b39c0177-1cfb-4eb0-bb14-c269dc7484e9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.245750 Sep 05 14:38:36.718141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 242/467] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:36 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:36.824966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:36.834695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:36.836641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:36.838039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7fe230c6-d997-4bce-aa8e-510836f8a468 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.178138 Sep 05 14:38:36.839548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 226/468] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:37.588386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:37.589746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:37.596865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:37.597651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:37.598311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:37.599424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:37.600114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:37.600589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:37.706265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:37.716165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7de9bf7-85d5-4ab3-abf3-17a693c8301b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1311 microversion: 2.1 time: 0.131739 Sep 05 14:38:37.717435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 243/469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1311 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:37.742577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:37.743206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:37.750076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:37.750811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:37.751455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:37.752254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:37.752882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:37.753354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:37.773310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:37.868654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:37.869520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:37.876592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:37.877285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:37.877889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:37.878827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:37.879427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:37.880017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:38.057690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:38.065920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-519357a7-accb-4e11-b247-6c50332981e3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.327892 Sep 05 14:38:38.083285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 227/470] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:37 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:38.214617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:38.221164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:38.230345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:38.232333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:38.235348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-95284c3c-c63f-48e8-8e7a-9ead498e8302 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1723 microversion: 2.20 time: 0.372557 Sep 05 14:38:38.236243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 244/471] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1723 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:38.741364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:38.742095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:38.753577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:38.754385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:38.755548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:38.757632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:38.760252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:38.761083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:38.824558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-15c5b9b1-0adc-456d-815f-9e4e8feadc8d req-f864bfe7-0dbe-4c03-8503-88c6dd16b4d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8135d8b8-fc8e-404c-a3d2-90595028a8bf", "name": "network-vif-plugged", "status": "completed", "tag": "b6e63722-ab5f-4e8a-a5a1-256e8465473b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:38.852112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-15c5b9b1-0adc-456d-815f-9e4e8feadc8d req-f864bfe7-0dbe-4c03-8503-88c6dd16b4d9 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:38.852778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-15c5b9b1-0adc-456d-815f-9e4e8feadc8d req-f864bfe7-0dbe-4c03-8503-88c6dd16b4d9 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:38.853482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-15c5b9b1-0adc-456d-815f-9e4e8feadc8d req-f864bfe7-0dbe-4c03-8503-88c6dd16b4d9 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:38.870119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:38.873637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-15c5b9b1-0adc-456d-815f-9e4e8feadc8d req-f864bfe7-0dbe-4c03-8503-88c6dd16b4d9 service nova] Creating event network-vif-plugged:b6e63722-ab5f-4e8a-a5a1-256e8465473b for instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf on hv-cinder-84290 Sep 05 14:38:38.878902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e8953018-cf47-48cd-af84-e44289a676fc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1311 microversion: 2.1 time: 0.141821 Sep 05 14:38:38.879499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 228/472] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1311 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:38.901746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-15c5b9b1-0adc-456d-815f-9e4e8feadc8d req-f864bfe7-0dbe-4c03-8503-88c6dd16b4d9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081382 Sep 05 14:38:38.902272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 245/473] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:38:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:38:39.094319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:39.095119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:39.109879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:39.110375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:39.110883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:39.111550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:39.116532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:39.122305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:39.266478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:39.267459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:39.283272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:39.283888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:39.287235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:39.288032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:39.288506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:39.288996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:39.563285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:39.582590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9a42d932-4d23-48fe-839d-fae84d2bd6d2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.492925 Sep 05 14:38:39.583478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 229/474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:39 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:39.692532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:39.708228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:39.711130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:39.712601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-630bdea7-fbe2-4154-91a0-64879487defa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.451606 Sep 05 14:38:39.716362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 246/475] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:39.901500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:39.902124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:39.909432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:39.910116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:39.910735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:39.911845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:39.912471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:39.913054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:40.024521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:40.034885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ef2c951-bc85-4428-bf07-0134746aa791 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1317 microversion: 2.1 time: 0.136786 Sep 05 14:38:40.035470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 230/476] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1317 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:40.606290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:40.607214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:40.610315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=7 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:40.622369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:40.622901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:40.623342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:40.624079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:40.624538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:40.624957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:40.745077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:40.745954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:40.753174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:40.753949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:40.754605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:40.755535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:40.756246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:40.756886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:40.881672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:40.891631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8384a74e-8e6b-4126-a89e-af88ac60428f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.289471 Sep 05 14:38:40.892545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 247/477] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:40 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:40.992538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:41.005843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:41.008136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:41.008897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6ce96987-8624-48fd-815e-a1dc912298a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.267812 Sep 05 14:38:41.014870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 231/478] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:41.059803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:41.060812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:41.067358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:41.067917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:41.069209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:41.069460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:41.069924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:41.070624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:41.284558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:41.293483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d40a24c0-e8c2-4aa8-8712-b247e823bfa7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.237498 Sep 05 14:38:41.294352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 248/479] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:41.920451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:41.921987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:41.929547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:41.930594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:41.931286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:41.932219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:41.932910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:41.933556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:42.035145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:42.036380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:42.046183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:42.050506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:42.051541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:42.052865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:42.053709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:42.054861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:42.207453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:42.246367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5d579be1-0c19-4ee7-a0e2-c0eeb8d0871a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.329790 Sep 05 14:38:42.251146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 232/480] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:41 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:42.320625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:42.323904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:42.352104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:42.353013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:42.353739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:42.354667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:42.355655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:42.356385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:42.358672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:42.370424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:42.372154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:42.373993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-35d35fab-d640-4920-a1e2-24382894ff1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.342595 Sep 05 14:38:42.375151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 249/481] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:42.594219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:42.603134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4518ba7d-b3c0-436f-b87c-0414f23471c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.289456 Sep 05 14:38:42.605703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 233/482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:43.298950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:43.300314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:43.307133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:43.307704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:43.308253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:43.309030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:43.309573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:43.310068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:43.407103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:43.407699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:43.421188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:43.421685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:43.422122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:43.422856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:43.423312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:43.423737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:43.601915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:43.622957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9057719b-0c36-440d-b6a5-5e213019c79f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.327796 Sep 05 14:38:43.643525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 250/483] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:43 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:43.674687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:43.676140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:43.696200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:43.703766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:43.706061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:43.707054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:43.708254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:43.708918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:43.921239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:43.939183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:43.941029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:43.947804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-29e6eae9-faaf-400b-b443-32a6c9afb12d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.543305 Sep 05 14:38:43.951159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 234/484] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:43.996848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-c8f4e619-ad17-4d12-b22f-ef08792cf9fe req-56538bd6-77ee-4fc0-b60d-6337db9d37ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "name": "network-vif-plugged", "status": "completed", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:44.018605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c8f4e619-ad17-4d12-b22f-ef08792cf9fe req-56538bd6-77ee-4fc0-b60d-6337db9d37ac service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:44.020359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c8f4e619-ad17-4d12-b22f-ef08792cf9fe req-56538bd6-77ee-4fc0-b60d-6337db9d37ac service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:44.022333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c8f4e619-ad17-4d12-b22f-ef08792cf9fe req-56538bd6-77ee-4fc0-b60d-6337db9d37ac service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:44.051594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-c8f4e619-ad17-4d12-b22f-ef08792cf9fe req-56538bd6-77ee-4fc0-b60d-6337db9d37ac service nova] Creating event network-vif-plugged:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:38:44.057685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:44.065346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-c8f4e619-ad17-4d12-b22f-ef08792cf9fe req-56538bd6-77ee-4fc0-b60d-6337db9d37ac service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072439 Sep 05 14:38:44.066321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 235/485] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:38:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:44.071759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e5596845-76e0-4583-a0cc-b6ae4e03b767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.426908 Sep 05 14:38:44.096505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 251/486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:44.540708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ad08ccf5-368e-44f9-834a-7af6c2ee973e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Action: 'create', calling method: .version_select at 0x7fb19163f700>, body: {"keypair": {"name": "tempest-TestShelveInstance-2017107774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPUKxYhr7v/asTVCd7gRoLzYhSpvoJ/551uMim3UMNITCOUAWzDqTxA3naWHM5LXzJ0ihmFUi5AFuSybIHU7qquJAlA8ufr3Nlgg6H5NqTBK2MTQF0x067TxEXD90lphqg=="}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:44.557107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-ad08ccf5-368e-44f9-834a-7af6c2ee973e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Getting quotas for project 172738e7ad624a429835832020a92723. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:38:44.562095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-ad08ccf5-368e-44f9-834a-7af6c2ee973e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Getting quotas for user 60b48954cad94ade83e974fa28063b7d and project 172738e7ad624a429835832020a92723. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:38:44.652667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ad08ccf5-368e-44f9-834a-7af6c2ee973e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.331178 Sep 05 14:38:44.653565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 236/487] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:38:44 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:44.674701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:44.675362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:44.681268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:44.681754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:44.682190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:44.682920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:44.683375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:44.683854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:44.847135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:44.855855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a2d0c50-e216-467b-a2cb-7eebabc9cbfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.201565 Sep 05 14:38:44.883575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 252/488] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:44 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:44.976432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:44.977157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:44.985470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:44.986772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:44.987420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:44.988318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:44.989079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:44.989667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:45.105911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:45.106579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:45.114623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:45.118735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:45.119909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:45.123738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:45.124715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:45.129877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:45.153201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:45.335825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:45.349416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:45.353047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:45.356077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-69e68c32-44f1-48cc-9258-c2a829be9acc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.383649 Sep 05 14:38:45.375931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 237/489] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:45.384987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-4af30ff6-0b7d-4901-8d1d-4cdcf5f85a72 req-65ff0acc-5824-4dcb-8708-418f7a54415f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:45.396149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4af30ff6-0b7d-4901-8d1d-4cdcf5f85a72 req-65ff0acc-5824-4dcb-8708-418f7a54415f service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:45.396775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4af30ff6-0b7d-4901-8d1d-4cdcf5f85a72 req-65ff0acc-5824-4dcb-8708-418f7a54415f service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:45.401268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4af30ff6-0b7d-4901-8d1d-4cdcf5f85a72 req-65ff0acc-5824-4dcb-8708-418f7a54415f service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:45.416785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=12 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:45.426474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-4af30ff6-0b7d-4901-8d1d-4cdcf5f85a72 req-65ff0acc-5824-4dcb-8708-418f7a54415f service nova] Creating event network-changed:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 14:38:45.431891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-4af30ff6-0b7d-4901-8d1d-4cdcf5f85a72 req-65ff0acc-5824-4dcb-8708-418f7a54415f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054980 Sep 05 14:38:45.432615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 238/490] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:45.475644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:45.483805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0f2a830-940a-4b62-9bc9-5fe2bf79d349 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.382006 Sep 05 14:38:45.490492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 253/491] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:45.887466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:45.889030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:45.897213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:45.897923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:45.898513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:45.899561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:45.900266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:45.900843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:46.069604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:46.078365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-43578dcc-c2b1-405d-a842-4f3deee8756a tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.196484 Sep 05 14:38:46.079197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 239/492] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:45 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:46.388785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:46.389523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:46.396960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:46.397468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:46.397909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:46.398622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:46.399205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:46.399709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:46.506875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:46.508644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:46.521210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:46.521701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:46.522135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:46.525238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:46.525238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:46.525238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:46.681782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:46.698913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:46.701172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:46.711006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6aace1a-ba63-4cf2-80f7-de74d213cbbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.320087 Sep 05 14:38:46.727347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 254/493] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:46.864863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:46.877042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ee7fa1b7-fbce-490f-8c20-1b22b851d285 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.374161 Sep 05 14:38:46.882979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 240/494] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:47.103865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:47.105000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:47.123366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:47.123927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:47.124360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:47.125061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:47.125683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:47.126296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:47.330551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:47.339013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-df9dacf4-5021-459b-bccc-6f7a4f060eb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.241380 Sep 05 14:38:47.339804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 255/495] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:47 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:47.742417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:47.743093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:47.750633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:47.751403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:47.751838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:47.752557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:47.753210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:47.753868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:47.903262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:47.905762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:47.907090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:47.912723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:47.913585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:47.914065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:47.914500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:47.914618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:47.915223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:47.915675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:47.916016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c2c4de6c-e6b9-4986-b03a-67ef512d8ae8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.177574 Sep 05 14:38:47.916261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:47.916710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 241/496] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:48.075788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:48.085948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1fe3638d-5f28-4b5f-8880-75bdbf7faf0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.184617 Sep 05 14:38:48.086520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 256/497] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:48.368102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:48.369326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:48.381932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:48.394101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:48.394916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:48.395714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:48.399238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:48.399897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:48.400369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:48.643301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:48.659854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae77dd72-8d16-4ea2-8b07-b332f8deeb46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.300478 Sep 05 14:38:48.662911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 242/498] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:48 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:48.941715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:48.942325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:48.949499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:48.949981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:48.950493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:48.951393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:48.952025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:48.952596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:49.109406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:49.109995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:49.111520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:49.120369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:49.122005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:49.123332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8de97553-38a8-4cff-8357-102813879a67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.185535 Sep 05 14:38:49.123917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 257/499] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:49.129582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:49.130017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:49.138653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:49.138653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:49.138653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:49.138653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:49.389782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:49.398617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8be3277f-9a13-436a-a31e-64dd5bb87e71 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.293440 Sep 05 14:38:49.399238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 243/500] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:49.685832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:49.687351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:49.695351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:49.703624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:49.704345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:49.705095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:49.705554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:49.705975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:49.860412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:49.868696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4af943d2-f556-4496-a201-4c8c4810e769 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.186705 Sep 05 14:38:49.869263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 258/501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:49 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:50.150923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:50.151535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:50.159076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:50.159482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:50.159923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:50.160615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:50.161070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:50.161494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:50.429034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:50.429608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:50.437233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:50.437441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:50.437886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:50.438591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:50.439073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:50.439501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:50.551061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:50.563252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:50.567456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:50.567456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-076c01ed-6b3c-475a-b95f-93b69e83cca3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.419825 Sep 05 14:38:50.567758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 244/502] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:50.605258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:50.613241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b773580-106d-45f9-837f-efc7c5baa221 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.188279 Sep 05 14:38:50.614129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 259/503] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:50.892697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:50.893348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:50.899318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:50.899867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:50.900273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:50.900984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:50.901439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:50.901858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:51.037962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:51.045613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-36c8d083-6e6b-45fa-a8e8-3f9b715c58c6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.156773 Sep 05 14:38:51.046846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 245/504] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:50 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:51.592417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:51.593886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:51.600713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:51.601183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:51.601612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:51.602288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:51.602737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:51.603425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:51.635913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:51.636523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:51.643689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:51.644246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:51.644698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:51.645368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:51.645815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:51.646230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:51.664166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:51.779392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:51.787308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:51.790984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:51.790984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-12bef828-29d3-46ec-aa33-72611bbfe383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.201660 Sep 05 14:38:51.790984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 260/505] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:51.809372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:51.817590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-268e3bb0-6176-4df2-893e-a384035d70ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.185457 Sep 05 14:38:51.818129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 246/506] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:52.068779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:52.069505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:52.082418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:52.082956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:52.083386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:52.084084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:52.084533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:52.084956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:52.210163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:52.217718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b68549ff-5fa7-4df5-8828-7bdecf2e37aa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.152712 Sep 05 14:38:52.219126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 261/507] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:52 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:52.820836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:52.821553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:52.828540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:52.829022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:52.829451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:52.830320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:52.830779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:52.831230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:52.840767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:52.841377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:52.848262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:52.848986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:52.849625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:52.850643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:52.851345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:52.851965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:52.856448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:53.043120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:53.053702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:53.055553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:53.057540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d90e8c93-4258-409c-836e-38f3343f8ef4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.240679 Sep 05 14:38:53.058657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 247/508] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:53.071046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:53.082538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c3903829-d332-4d25-bc84-35e2e907b2c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.245495 Sep 05 14:38:53.083692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 262/509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:53.242165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:53.242963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:53.249638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:53.250413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:53.250955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:53.251729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:53.252351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:53.252787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:53.400801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:53.408340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c49cf464-e82d-4b26-a927-7d996864de11 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.170522 Sep 05 14:38:53.408891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 248/510] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:53 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:54.084189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:54.084850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:54.092366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:54.093775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:54.094444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:54.095467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:54.096148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:54.096677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:54.110090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:54.110839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:54.128732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:54.129228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:54.129680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:54.130400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:54.130859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:54.131288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:54.376415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:54.384773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bfd46ee3-adb1-4c85-b167-ad25a3621919 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.280324 Sep 05 14:38:54.386002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 249/511] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:54.412930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:54.413396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:54.415278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:54.416559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0ea3f92e-6ad6-4e7b-a1fa-4775e2b730b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.337314 Sep 05 14:38:54.417120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 263/512] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:54.431645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:54.432690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:54.439130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:54.439700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:54.441158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:54.441158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:54.441579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:54.441975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:54.568739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:38:54.590141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:54.598470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b5b48f99-3822-4188-b3cf-7f20c6febd80 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.171359 Sep 05 14:38:54.599074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 250/513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:54 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:55.407884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:55.408501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:55.415049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:55.415531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:55.421159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:55.421159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:55.421159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:55.421159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:55.445653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:55.446387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:55.453044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:55.454028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:55.454467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:55.455193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:55.455651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:55.456074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:55.596203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:55.603893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-91bb2972-488c-4bd7-a36f-1de09d85e181 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.199874 Sep 05 14:38:55.604675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 264/514] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:55.621470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:55.623909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:55.624540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:55.630108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:55.631590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:55.633177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:55.633177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:55.633414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cd060a79-2937-4efd-9272-68fa3269fe50 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.191384 Sep 05 14:38:55.633523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:55.633761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 251/515] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:38:55.633964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:55.634418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:55.634860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:55.774318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:55.781020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88203ad6-b27c-4d1a-8d3b-d26c0fe31b3c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1365 microversion: 2.1 time: 0.160898 Sep 05 14:38:55.781573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 265/516] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:55 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1365 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:56.631840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:56.632441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:56.638740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:56.639244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:56.639671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:56.640352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:56.640795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:56.641213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:56.658980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:56.659579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:56.666378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:56.666906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:56.667345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:56.668044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:56.668499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:56.668924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:56.840111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:56.848914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:56.850801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-90cfb982-e4ad-45fb-aeb2-0bf7bfe59f26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.223725 Sep 05 14:38:56.862320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 252/517] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:38:56.862320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:56.862320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:56.864205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:56.864780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:56.865271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:56.866030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:56.866546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:56.867110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:56.872270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:56.872549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:56.873927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8385c9db-0182-4ae6-af96-a50f8eac7438 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.218927 Sep 05 14:38:56.874487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 266/518] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:56.999342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:57.007728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c4f753e9-af0f-4275-9929-5791ceae3fc1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1555 microversion: 2.1 time: 0.154480 Sep 05 14:38:57.008378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 253/519] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:56 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:57.030510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:57.031644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:57.037676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:57.045725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:57.045725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:57.045725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:57.045725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:57.046157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:57.126199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-53628024-6701-4ae9-af5b-2aaf5c4e5c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097991 Sep 05 14:38:57.126199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 267/520] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 14:38:57 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:38:57.874280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:57.875516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:57.882140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:57.882708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:57.883276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:57.883982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:57.884438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:57.884869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:57.899432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:57.900669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:57.907771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:57.908261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:57.908699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:57.909395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:57.910023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:57.910448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:58.172345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:58.180058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-28142a3c-9e33-4955-b50a-28b5abae585e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.310245 Sep 05 14:38:58.180628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 254/521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:58.214868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:58.223225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:58.224653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:58.225804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-25f9fe42-7872-41cf-bc0e-195d04eee050 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.330316 Sep 05 14:38:58.226358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 268/522] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:38:58.393308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-b7a40e0d-97a5-4f03-b6bf-8e3b8e6fa358 req-47eb37d8-89da-45d9-828e-0cbeb8a96198 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8135d8b8-fc8e-404c-a3d2-90595028a8bf", "tag": "b6e63722-ab5f-4e8a-a5a1-256e8465473b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:38:58.404697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b7a40e0d-97a5-4f03-b6bf-8e3b8e6fa358 req-47eb37d8-89da-45d9-828e-0cbeb8a96198 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:58.410467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b7a40e0d-97a5-4f03-b6bf-8e3b8e6fa358 req-47eb37d8-89da-45d9-828e-0cbeb8a96198 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:58.410467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b7a40e0d-97a5-4f03-b6bf-8e3b8e6fa358 req-47eb37d8-89da-45d9-828e-0cbeb8a96198 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:58.417429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-b7a40e0d-97a5-4f03-b6bf-8e3b8e6fa358 req-47eb37d8-89da-45d9-828e-0cbeb8a96198 service nova] Creating event network-changed:b6e63722-ab5f-4e8a-a5a1-256e8465473b for instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf on hv-cinder-84290 Sep 05 14:38:58.423221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-b7a40e0d-97a5-4f03-b6bf-8e3b8e6fa358 req-47eb37d8-89da-45d9-828e-0cbeb8a96198 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033735 Sep 05 14:38:58.423802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 255/523] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:38:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:38:59.203000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:59.203612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:59.210379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:59.211006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:59.211451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:59.212151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:59.212605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:59.213025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:59.252609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:38:59.253972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:38:59.260921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:59.261746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:59.262177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:59.263076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:38:59.263561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:38:59.263952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:38:59.410017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:59.418606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-982a955b-9601-49f2-997b-1740d0e9dd65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.219478 Sep 05 14:38:59.419607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 269/524] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:38:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:38:59.443218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:59.451732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:59.453186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:38:59.454387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-98618ef1-205d-44e2-9387-468388b90ea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.205974 Sep 05 14:38:59.454957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 256/525] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:38:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:00.442280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:00.442961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:00.449431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:00.449884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:00.450315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:00.451029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:00.451476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:00.451891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:00.480530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:00.481133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:00.488340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:00.489119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:00.489587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:00.490311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:00.490758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:00.491237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:00.632463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:00.640102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-624c420d-6787-4440-b67c-a33fe5446926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.202362 Sep 05 14:39:00.640761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 270/526] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:00.658278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:00.666195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:00.667662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:00.668810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0fc82bee-e0bb-4b8d-83b1-d8fc2fea8193 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1744 microversion: 2.20 time: 0.192196 Sep 05 14:39:00.669353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 257/527] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1744 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:01.674098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:01.675495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:01.686680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:01.693576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:01.695771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:01.695903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:01.695903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:01.696470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:01.696470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:01.696660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:01.714637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:01.715156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:01.715588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:01.716293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:01.716901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:01.717456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:01.946112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:01.953976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-15b9d7f3-f294-49ec-80f9-658f3d8c1a83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.286648 Sep 05 14:39:01.958252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 271/528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:01.966283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:01.979406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:01.981467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:01.983034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d6663f6b-6dd7-4ddb-baa9-cda7fa28e46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.292696 Sep 05 14:39:01.983863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 258/529] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:02.980697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:02.981805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:02.990515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:02.991067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:02.991575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:02.992256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:02.992710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:02.993159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:03.015939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:03.016459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:03.027982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:03.028751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:03.029375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:03.030097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:03.030550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:03.031556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:03.272279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:03.282062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a0e2499b-132a-413b-848d-cc65ab9aaeee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.305456 Sep 05 14:39:03.282670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 272/530] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:03.317775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:03.327280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:03.331008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:03.332639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18441721-1664-46df-919d-c4c6fd90ffa8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.320894 Sep 05 14:39:03.345442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 259/531] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:04.142070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-e3d54672-3341-4e91-b025-b0ffade98af7 req-a3bc0c1c-6583-465e-9571-f5afeb2b0b5b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "name": "network-vif-plugged", "status": "completed", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:04.165927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-e3d54672-3341-4e91-b025-b0ffade98af7 req-a3bc0c1c-6583-465e-9571-f5afeb2b0b5b service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:04.167775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-e3d54672-3341-4e91-b025-b0ffade98af7 req-a3bc0c1c-6583-465e-9571-f5afeb2b0b5b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:04.168502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-e3d54672-3341-4e91-b025-b0ffade98af7 req-a3bc0c1c-6583-465e-9571-f5afeb2b0b5b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:04.183482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-e3d54672-3341-4e91-b025-b0ffade98af7 req-a3bc0c1c-6583-465e-9571-f5afeb2b0b5b service nova] Creating event network-vif-plugged:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 14:39:04.190312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-e3d54672-3341-4e91-b025-b0ffade98af7 req-a3bc0c1c-6583-465e-9571-f5afeb2b0b5b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052629 Sep 05 14:39:04.191683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 273/532] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:04.305968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:04.306496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:04.322880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:04.325293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:04.325908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:04.326816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:04.327429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:04.328808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:04.361841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:04.362860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:04.380845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:04.381333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:04.384611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:04.385355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:04.388308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:04.388742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:04.752863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:04.756345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:04.764556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3551bd8b-4f21-4253-9851-a007fb380a05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.462923 Sep 05 14:39:04.767541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 260/533] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:04.779236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:04.780998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:04.786656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-866254b1-cdfa-42f6-a873-ac04c5c08eb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.429368 Sep 05 14:39:04.788849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 274/534] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:05.792001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:05.792616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:05.801255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:05.801818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:05.802318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:05.803114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:05.803651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:05.804139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:05.815767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:05.816379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:05.823885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:05.825297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:05.826115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:05.827011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:05.827640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:05.828842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:06.243171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:06.255188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b66a9552-527e-4ad8-a476-589f48656425 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.466834 Sep 05 14:39:06.256131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 261/535] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:06.292090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:06.311478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:06.313856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:06.315266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-59f44c41-d978-4894-b67c-dcb3a4ed5615 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.503821 Sep 05 14:39:06.319052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 275/536] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:07.290474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:07.295047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:07.316639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:07.322564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:07.322564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:07.322564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:07.322564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:07.322914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:07.354300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:07.355402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:07.381117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:07.381977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:07.382749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:07.397290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:07.409974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:07.416839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:07.662091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:07.675221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-74dbabe6-87bd-4cad-b0ca-fbac16fa54ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1359 microversion: 2.1 time: 0.393834 Sep 05 14:39:07.676225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 262/537] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:07.749038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:07.758703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:07.760417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:07.761581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-99e3d7f9-9ff7-440b-84f2-df92f6ccd65c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.417129 Sep 05 14:39:07.764272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 276/538] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:08.700782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:08.701332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:08.708634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:08.709164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:08.709603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:08.710323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:08.710810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:08.711225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:08.813597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:08.815267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:08.859758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:08.862586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:08.863128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:08.870108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:08.870108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:08.870427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:08.946271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:08.946271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:08.946271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3fd75235-25f4-4232-bbef-d94e5ce17fed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1548 microversion: 2.1 time: 0.232670 Sep 05 14:39:08.946271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 263/539] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1548 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:08.946701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-553304671", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:09.001811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] validate_networks() for None {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:39:09.065599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.078254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.079720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.081478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fb506b87-5c83-4d8b-a465-810235930651 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.275742 Sep 05 14:39:09.082224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 277/540] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:09.106139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:09.107017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:09.113579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.114064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.114509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.115206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.115654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.116105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.352240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.360160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0de1803b-3745-4b3c-9e82-70a7a708a7cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1548 microversion: 2.1 time: 0.260964 Sep 05 14:39:09.360735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 278/541] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1548 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:09.386940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:09.387094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:39:09.387094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:39:09.387303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.387415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:39:09.387415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:39:09.387565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:39:09.387864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Searching by: {'deleted': False, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603'} {{(pid=127608) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 05 14:39:09.395119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.395669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.396178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.396913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.397367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.397817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.397926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.398384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.398826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.399946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.400545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.400859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.418532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Getting quotas for project 56deac6e76ee41f38fd2ca1f5a6536ec. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:39:09.422573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Getting quotas for user 53398ecdd31e447ea317eeeaa78a0927 and project 56deac6e76ee41f38fd2ca1f5a6536ec. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:39:09.435013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:39:09.439142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:39:09.492097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.multi_cell_list [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127608) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 05 14:39:09.545993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:09.609073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-91cdb109-6225-4eaa-a6ad-bc70ce963ccd tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678082 Sep 05 14:39:09.615696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 264/542] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:39:08 2022] POST /compute/v2.1/servers => generated 380 bytes in 679 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:39:09.615858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8d080ff7-bbf5-4c1b-bfdd-a36fbdc980b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.233389 Sep 05 14:39:09.615858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 279/543] 10.222.0.15 () {58 vars in 1125 bytes} [Mon Sep 5 14:39:09 2022] GET /compute/v2.1/servers => generated 343 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:39:09.628230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:09.629350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:09.629961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1cdd9a4b-4747-49c4-b251-27a3178ec1c9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:09.630591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1cdd9a4b-4747-49c4-b251-27a3178ec1c9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:09.650241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.650850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.656485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.657318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:09.657846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:09.658347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:09.709303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1cdd9a4b-4747-49c4-b251-27a3178ec1c9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.719574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1cdd9a4b-4747-49c4-b251-27a3178ec1c9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1214 microversion: 2.1 time: 0.097185 Sep 05 14:39:09.720194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 265/544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:09 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:09.856452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:09.862031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c78ba852-d5b9-4f64-b032-9f2d910350dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1548 microversion: 2.1 time: 0.240138 Sep 05 14:39:09.869567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 280/545] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1548 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:10.115554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:10.116160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:10.122202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:10.122999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:10.123503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:10.124310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:10.124799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:10.125219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:10.312207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:10.326736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:10.334660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:10.334660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9701cf79-2a25-4378-9368-7b00efadc041 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.220689 Sep 05 14:39:10.334660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 266/546] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:10.745993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06715f23-f20b-41f4-92d5-c442d4ff916a tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:10.750595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06715f23-f20b-41f4-92d5-c442d4ff916a tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:10.750595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=68 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:10.808291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-06715f23-f20b-41f4-92d5-c442d4ff916a tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:10.816386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06715f23-f20b-41f4-92d5-c442d4ff916a tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1214 microversion: 2.1 time: 0.074788 Sep 05 14:39:10.827836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 281/547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:10 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:11.363905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:11.364709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:11.373020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:11.373761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:11.374357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:11.375410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:11.376037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:11.376860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:11.732780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:11.742652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:11.744779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:11.746379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3ffc964d-8016-4275-b9fc-c90246106fe2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.386887 Sep 05 14:39:11.773038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 267/548] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:11.840524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:11.841235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:11.854657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:11.855178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:11.855611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:11.856307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:11.856759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:11.857181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:11.931627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:11.941694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce11ebb0-9e02-4603-8dc7-5850765d42ff tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1266 microversion: 2.1 time: 0.105048 Sep 05 14:39:11.942245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 282/549] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:11 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:12.781798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:12.783093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:12.796812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:12.797607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:12.798737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:12.799652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:12.800281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:12.800857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:12.965791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:12.967429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:12.978946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:12.984159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:12.984974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:12.986099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:12.986824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:12.987498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:13.040681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:13.058196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:13.064222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:13.065596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5879b584-d10d-4f79-a2b5-3632d960e51e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.288213 Sep 05 14:39:13.072202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 268/550] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:13.220036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81152632-7f7d-4c39-9601-23b15857f1b1"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:13.222458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:13.229389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:13.230140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:13.230755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:13.231651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:13.232103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:13.232526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:13.253356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:13.261824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70afab06-61ec-4d47-9786-b2710eb4580e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1284 microversion: 2.1 time: 0.300225 Sep 05 14:39:13.276583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 283/551] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:12 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1284 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:14.102974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:14.242621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:14.242621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:14.242621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:14.242621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:14.243683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:14.243683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:14.243683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:14.244294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:14.252935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:14.254462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:14.255690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-45822667-0eb7-4b4b-92ac-e530350e08bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.156801 Sep 05 14:39:14.256319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 284/552] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:14.287079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:14.287785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:14.294424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:14.295030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:14.295555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:14.296403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:14.297080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:14.297618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:14.378680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:14.389638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ec24cac3-fa86-475f-91a7-73454e883e18 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1272 microversion: 2.1 time: 0.106657 Sep 05 14:39:14.403372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 285/553] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:14 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:14.781537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a785d34-7770-4932-ab23-c9d045f92d25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.565916 Sep 05 14:39:14.782276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 269/554] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:39:13 2022] POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 194 bytes in 1567 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:39:15.282909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:15.283490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:15.292680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:15.293651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:15.294278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:15.295357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:15.296370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:15.297006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:15.416584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:15.417721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:15.425914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:15.427419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:15.428134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:15.429114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:15.429807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:15.430470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:15.466133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:15.492167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:15.492167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:15.492167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d79c14b1-6888-4450-868e-afd3590fe1ab tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.202627 Sep 05 14:39:15.492530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 286/555] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:15.575518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:15.584000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4a716b5e-a43e-4d0e-934d-432cc4428f01 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.171872 Sep 05 14:39:15.584557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 270/556] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:15 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:16.215579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-7f04a8c8-a6ad-4981-9a8c-4462530c839a req-de06c1ee-2215-462c-9e2b-f3c381cdcbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ae52220-4b49-437e-95f7-89116100fa1b", "tag": "099fdff0-0e7a-40fc-90d0-c3801e017d98"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:16.226853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-7f04a8c8-a6ad-4981-9a8c-4462530c839a req-de06c1ee-2215-462c-9e2b-f3c381cdcbb5 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:16.227677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-7f04a8c8-a6ad-4981-9a8c-4462530c839a req-de06c1ee-2215-462c-9e2b-f3c381cdcbb5 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:16.227826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-7f04a8c8-a6ad-4981-9a8c-4462530c839a req-de06c1ee-2215-462c-9e2b-f3c381cdcbb5 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:16.238659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-7f04a8c8-a6ad-4981-9a8c-4462530c839a req-de06c1ee-2215-462c-9e2b-f3c381cdcbb5 service nova] Creating event network-changed:099fdff0-0e7a-40fc-90d0-c3801e017d98 for instance 8ae52220-4b49-437e-95f7-89116100fa1b on hv-cinder-84290 Sep 05 14:39:16.244390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-7f04a8c8-a6ad-4981-9a8c-4462530c839a req-de06c1ee-2215-462c-9e2b-f3c381cdcbb5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032653 Sep 05 14:39:16.244979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 287/557] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:39:16.506016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:16.506639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:16.512909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:16.513413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:16.513841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:16.514522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:16.514999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:16.516045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:16.609102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:16.609816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:16.616347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:16.617061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:16.617645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:16.619364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:16.619972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:16.621046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:16.652967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:16.662223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:16.663727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:16.664890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1543c92a-d034-49f2-8b9f-9b953f420f63 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.162774 Sep 05 14:39:16.665451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 271/558] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:16.753319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:16.766782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a61b0616-a9c0-43d4-b365-790d60abf0e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.162041 Sep 05 14:39:16.767397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 288/559] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:16 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:17.691223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:17.691850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:17.698243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:17.698715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:17.699175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:17.699849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:17.700324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:17.700738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:17.790307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:17.790947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:17.797017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:17.797497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:17.797930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:17.798618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:17.799105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:17.799527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:17.829101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:17.837198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:17.838747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:17.839997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-02edb585-d5d3-4380-a9f8-81207b766706 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.152942 Sep 05 14:39:17.840632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 272/560] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:17.927576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:17.935100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eb82ce9a-5226-4d09-8c46-529d53241538 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.148443 Sep 05 14:39:17.935668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 289/561] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:17 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:18.866703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:18.867337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:18.873676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:18.874158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:18.875130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:18.875814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:18.876271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:18.876695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:18.958077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:18.958687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:18.965244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:18.965664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:18.966097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:18.966877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:18.967439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:18.967867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:19.019203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:19.028009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:19.029275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:19.030488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ecfdc340-7746-48e3-bbcf-fd3bd4304c43 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.167674 Sep 05 14:39:19.031220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 273/562] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:19.107114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:19.115322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-501ad499-c49a-455a-bbed-603254c9853d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.161179 Sep 05 14:39:19.115877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 290/563] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:18 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:20.057280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:20.057918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:20.059957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:20.060680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=8 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:20.066519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:20.067047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:20.067462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:20.068164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:20.068610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:20.069027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:20.137344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:20.137957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:20.141066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:20.145903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:20.146383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:20.146842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:20.147540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:20.147995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:20.148418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:20.228297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:20.236787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:20.238262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:20.239514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dbc0486e-dd7e-48be-9aef-56829e848d69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.186392 Sep 05 14:39:20.240069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 274/564] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:20.293080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:20.300649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3cd6e9ed-a71d-4b3e-a2ee-9d180d29428b tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.167109 Sep 05 14:39:20.301215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 291/565] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:20 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:21.265204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:21.265806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:21.268133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:21.272912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:21.273445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:21.273876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:21.274559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:21.275054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:21.275537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:21.324057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:21.324717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:21.326601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:21.331968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:21.332446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:21.332878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:21.333562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:21.334018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:21.334475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:21.443653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:21.453346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:21.455016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:21.456203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb050306-5bde-479c-819d-841e157a7eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1739 microversion: 2.20 time: 0.195210 Sep 05 14:39:21.457000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 275/566] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1739 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:21.492378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:21.501811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-928a02f1-bab5-4195-81c0-e92a2961dbda tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.181668 Sep 05 14:39:21.502436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 292/567] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:21 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:21.925334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-388759446", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2017107774", "security_groups": [{"name": "tempest-secgroup-smoke-2127409043"}], "networks": [{"uuid": "6894cfcf-f8be-49da-8f61-25f47412151d"}], "block_device_mapping_v2": [{"uuid": "4e481ea2-e6c8-4bb9-896b-d8228975ea92", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:22.048532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] validate_networks() for [('6894cfcf-f8be-49da-8f61-25f47412151d', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:39:22.278999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-96ec2a38-595f-4777-befd-7884937a1235 req-dd7277fc-9ebe-4c29-b4b8-56c0ba2e55f6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "name": "network-vif-unplugged", "status": "completed", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:22.289014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-96ec2a38-595f-4777-befd-7884937a1235 req-dd7277fc-9ebe-4c29-b4b8-56c0ba2e55f6 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.289716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-96ec2a38-595f-4777-befd-7884937a1235 req-dd7277fc-9ebe-4c29-b4b8-56c0ba2e55f6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.290212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-96ec2a38-595f-4777-befd-7884937a1235 req-dd7277fc-9ebe-4c29-b4b8-56c0ba2e55f6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.304124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-96ec2a38-595f-4777-befd-7884937a1235 req-dd7277fc-9ebe-4c29-b4b8-56c0ba2e55f6 service nova] Creating event network-vif-unplugged:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:39:22.309262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-96ec2a38-595f-4777-befd-7884937a1235 req-dd7277fc-9ebe-4c29-b4b8-56c0ba2e55f6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034071 Sep 05 14:39:22.309938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 293/568] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:22 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:39:22.442534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:39:22.443227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:39:22.443725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:39:22.444105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:39:22.444515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:39:22.453150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.453851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.454285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.455034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.455652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.456075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.474315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Getting quotas for project 172738e7ad624a429835832020a92723. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:39:22.478658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Getting quotas for user 60b48954cad94ade83e974fa28063b7d and project 172738e7ad624a429835832020a92723. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:39:22.484553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:22.485292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:22.493775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.494297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.494735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.495496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.495955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.496381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.563851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:39:22.566066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4e481ea2-e6c8-4bb9-896b-d8228975ea92',volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:39:22.667218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:22.676154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:22.677601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:22.678777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f275f24-77ba-4767-8e2f-5da731a5393a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1721 microversion: 2.20 time: 0.201040 Sep 05 14:39:22.679356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 294/569] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:22.684187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:22.684785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:22.690482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.690943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.691395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.692189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:22.692632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:22.693052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:22.822614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:22.830619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8649ecb2-688b-47a4-96f8-6c890d6802e2 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.150095 Sep 05 14:39:22.831221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 295/570] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:22 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:22.978997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ff2199e3-8969-4ed5-a918-1886aae362c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.057508 Sep 05 14:39:22.979672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 276/571] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:39:21 2022] POST /compute/v2.1/servers => generated 406 bytes in 1059 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:39:22.990621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bb61a256-c10a-4167-9d59-0a7224331c68 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:22.991292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bb61a256-c10a-4167-9d59-0a7224331c68 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:23.073383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bb61a256-c10a-4167-9d59-0a7224331c68 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:23.082316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bb61a256-c10a-4167-9d59-0a7224331c68 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1088 microversion: 2.1 time: 0.095448 Sep 05 14:39:23.089938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 296/572] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1088 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:23.711170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:23.711786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:23.718901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:23.719383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:23.719816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:23.720537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:23.720988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:23.721413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:23.851539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:23.853715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:23.854380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:23.861489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:23.861966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:23.862087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:23.862394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:23.863115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:23.863451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:23.863580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:23.863966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:23.864606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0f101a8a-9079-46b5-bbec-0b8240d6ccb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1721 microversion: 2.20 time: 0.157508 Sep 05 14:39:23.865160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 277/573] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:23.996736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:24.004347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-456c25a9-d62e-4c29-a43d-df95acba2940 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.154580 Sep 05 14:39:24.004907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 297/574] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:23 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:24.108188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:24.109552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:24.115795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.116290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.116699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.117380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.117826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.118243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.178478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:24.186097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d1780842-ed01-4242-a71c-c13481b40135 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1138 microversion: 2.1 time: 0.082085 Sep 05 14:39:24.186647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 278/575] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:24 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1138 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:24.501152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:24.501692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:24.507892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.514520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.514520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.514520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.514520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.515583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.628750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-6b3c6e60-987c-4c9d-88ef-cb9937c81520 req-224ac039-94b3-47fc-a696-df6ba1e8ca7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae52220-4b49-437e-95f7-89116100fa1b", "name": "network-vif-plugged", "status": "completed", "tag": "099fdff0-0e7a-40fc-90d0-c3801e017d98"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:24.639353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-6b3c6e60-987c-4c9d-88ef-cb9937c81520 req-224ac039-94b3-47fc-a696-df6ba1e8ca7d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.639749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-6b3c6e60-987c-4c9d-88ef-cb9937c81520 req-224ac039-94b3-47fc-a696-df6ba1e8ca7d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.640801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-6b3c6e60-987c-4c9d-88ef-cb9937c81520 req-224ac039-94b3-47fc-a696-df6ba1e8ca7d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.642313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:24.650548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9408d3a3-e145-4ee4-a775-7176a606b291 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1594 microversion: 2.1 time: 0.153266 Sep 05 14:39:24.658012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 298/576] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:24.658130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-6b3c6e60-987c-4c9d-88ef-cb9937c81520 req-224ac039-94b3-47fc-a696-df6ba1e8ca7d service nova] Creating event network-vif-plugged:099fdff0-0e7a-40fc-90d0-c3801e017d98 for instance 8ae52220-4b49-437e-95f7-89116100fa1b on hv-cinder-84290 Sep 05 14:39:24.659329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-6b3c6e60-987c-4c9d-88ef-cb9937c81520 req-224ac039-94b3-47fc-a696-df6ba1e8ca7d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036645 Sep 05 14:39:24.659941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 279/577] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:39:24.890117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:24.891310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:24.897676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.898153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.898584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.899397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:24.899859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:24.900281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:24.917858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:25.027975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:25.028704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:25.036018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:25.036499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:25.036935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:25.037662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:25.038147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:25.038568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:25.141845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:25.150104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:25.151580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:25.152745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5f3929fe-1fd9-450e-a8b6-829ca57422b0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1721 microversion: 2.20 time: 0.266801 Sep 05 14:39:25.153306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 299/578] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:25.208913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:25.209626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:25.215590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:25.216152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:25.216685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:25.217424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:25.217883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:25.219191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:25.278229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:25.286371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5a9e345d-d2f4-42f4-8fb0-6e46349ff9e1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.263242 Sep 05 14:39:25.286947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 280/579] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:25 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:25.297295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:25.305276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3028e94-9541-4e43-87c0-b6cff0d84cac tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1138 microversion: 2.1 time: 0.100177 Sep 05 14:39:25.305850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 300/580] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1138 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:26.295283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:26.295934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:26.302487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.303022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.303698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.304519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.305018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.305496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.308645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:26.309357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:26.316808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.317408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.317932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.318701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.319324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.319825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.556458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:26.565124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:26.566556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:26.567731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-922452dd-10a6-4205-82f0-03ca151eaa86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1724 microversion: 2.20 time: 0.392577 Sep 05 14:39:26.568348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 281/581] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1724 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:26.572754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:26.573351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:26.574502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:26.582476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e91d58a4-4099-4211-8880-a7c568dbd021 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.277786 Sep 05 14:39:26.592105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.593911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.593911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.594141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.594752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.595244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.600487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 301/582] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:26 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:26.600626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:26.604576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2192c5bd-ccf7-4161-9e80-1e5c4ea0808f"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:26.607648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:26.614671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.615308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.615983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.616918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:26.617580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:26.618095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:26.671109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:26.682843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-930b6856-125e-4ccc-90ce-00c521c51bde tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1186 microversion: 2.1 time: 0.113403 Sep 05 14:39:26.683611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 282/583] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1186 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:27.425176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-12a7db0e-27a5-4bf6-9046-de633c96ac7a req-f7512926-ea8a-4607-994e-b2b8b1ffd1c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:27.435888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-12a7db0e-27a5-4bf6-9046-de633c96ac7a req-f7512926-ea8a-4607-994e-b2b8b1ffd1c9 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.436548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-12a7db0e-27a5-4bf6-9046-de633c96ac7a req-f7512926-ea8a-4607-994e-b2b8b1ffd1c9 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.437038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-12a7db0e-27a5-4bf6-9046-de633c96ac7a req-f7512926-ea8a-4607-994e-b2b8b1ffd1c9 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.450022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-12a7db0e-27a5-4bf6-9046-de633c96ac7a req-f7512926-ea8a-4607-994e-b2b8b1ffd1c9 service nova] Creating event network-changed:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 14:39:27.455568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-12a7db0e-27a5-4bf6-9046-de633c96ac7a req-f7512926-ea8a-4607-994e-b2b8b1ffd1c9 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034554 Sep 05 14:39:27.456152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 283/584] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:39:27.623635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:27.623635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:27.635522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.636185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.636682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.637696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.638351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.639020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.640764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b0fc8cc0-8747-4c3e-b5c4-5c0e04761af1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.038729 Sep 05 14:39:27.641550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 302/585] 10.222.0.15 () {62 vars in 1364 bytes} [Mon Sep 5 14:39:26 2022] POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 188 bytes in 1042 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:39:27.715295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:27.716278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:27.733387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.733908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.734348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.735093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.735546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.735992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.837825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:27.847619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9501db59-7898-44e7-92ae-ab3fa1b95eb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1186 microversion: 2.1 time: 0.140769 Sep 05 14:39:27.848970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 303/586] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1186 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:27.854215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:27.855770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:27.867058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.867556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.867991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.868729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:27.869180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:27.869606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:27.872628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:27.881310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a1f13890-d7be-49a9-8b29-77f6e988af8c tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1314 microversion: 2.1 time: 0.272292 Sep 05 14:39:27.881800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 284/587] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:27 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1314 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:27.916405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127608) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 05 14:39:28.233491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-977d1720-bdac-4325-a219-da6160dd6c44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/action" status: 202 len: 0 microversion: 2.20 time: 0.382765 Sep 05 14:39:28.235569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 304/588] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 5 14:39:27 2022] POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/action => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:39:28.251893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:28.253371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:28.267849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:28.268774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:28.269663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:28.271026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:28.272109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:28.272898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:28.512478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:28.525928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:28.529161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:28.531428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bff9bedd-269f-437d-b816-d2c1c8811ec3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1810 microversion: 2.20 time: 0.288704 Sep 05 14:39:28.532663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 285/589] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1810 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:28.892423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:28.893770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:28.906762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:28.907670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:28.920661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:28.923276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:28.924385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:28.924385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:28.924952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:28.925410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:28.925838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:28.931733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:28.932192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:28.932965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:28.933421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:28.933909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.056282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:29.065194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a8d68da4-c0b1-42e8-9457-fe5bf9402369 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1186 microversion: 2.1 time: 0.195666 Sep 05 14:39:29.078848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 305/590] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1186 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:29.135794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:29.146422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f68b4fe0-b74f-4008-84d3-b1019f64c084 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1462 microversion: 2.1 time: 0.242651 Sep 05 14:39:29.146422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 286/591] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:28 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1462 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:29.199139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:29.199628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:29.205475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:29.205949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:29.206376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.207080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:29.207525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:29.207936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.235826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:39:29.567828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:29.568501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:29.576762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:29.576930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:29.577538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.578226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:29.578671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:29.579117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.632520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d23e065b-58ed-4dda-8712-77eab0e28a40 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 204 len: 0 microversion: 2.1 time: 0.433847 Sep 05 14:39:29.633601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 306/592] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:39:29 2022] DELETE /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 0 bytes in 439 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:39:29.642935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:29.643782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:29.650154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:29.650734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:29.651295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.652059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:29.652715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:29.653364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:29.881262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:29.890348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:29.891801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:29.892971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-abcf9ce8-7a60-4642-b2a9-a91de652f5e0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1750 microversion: 2.20 time: 0.329417 Sep 05 14:39:29.893521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 287/593] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1750 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:29.903684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:29.913206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-94463f33-df8a-40c2-b915-a4618fe18ca7 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1468 microversion: 2.1 time: 0.275286 Sep 05 14:39:29.913865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 307/594] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:29 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1468 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:30.088859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:30.089915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:30.097015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.097889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.098336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.099070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.099589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.100192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.162492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:30.170329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0190272-6d50-4806-acb4-895fd6dc06a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1194 microversion: 2.1 time: 0.085454 Sep 05 14:39:30.170917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 288/595] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:30.254988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2087962235"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:30.259798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:30.261505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.261984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.262415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.263137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.263591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.264011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.390473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.network.security_group_api [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Adding security group de9f8c0f-1106-4dae-8e94-6008c8aa4483 to port 9de7df6c-259e-4f36-ab19-ce48818db64b Sep 05 14:39:30.759180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c4fc6005-3f00-4cae-b893-174e3dcbafbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action" status: 202 len: 0 microversion: 2.1 time: 0.508124 Sep 05 14:39:30.759800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 308/596] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:39:30 2022] POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:39:30.770715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:30.771357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:30.778081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.778685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.779237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-1f510e1b-28e0-4580-94a4-585ed8d33cb3 req-98a448db-2d08-4e67-87bf-dfe60fb1a5df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:30.779364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.780175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.780730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.781253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.790320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-1f510e1b-28e0-4580-94a4-585ed8d33cb3 req-98a448db-2d08-4e67-87bf-dfe60fb1a5df service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.792205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-1f510e1b-28e0-4580-94a4-585ed8d33cb3 req-98a448db-2d08-4e67-87bf-dfe60fb1a5df service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.792205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-1f510e1b-28e0-4580-94a4-585ed8d33cb3 req-98a448db-2d08-4e67-87bf-dfe60fb1a5df service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.802737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-1f510e1b-28e0-4580-94a4-585ed8d33cb3 req-98a448db-2d08-4e67-87bf-dfe60fb1a5df service nova] Creating event network-changed:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 14:39:30.808189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-1f510e1b-28e0-4580-94a4-585ed8d33cb3 req-98a448db-2d08-4e67-87bf-dfe60fb1a5df service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032204 Sep 05 14:39:30.809242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 309/597] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:30.919770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:30.920573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:30.927219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.927787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.928299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.929026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.929486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.929905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.942696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:30.951266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f4385713-7443-46cb-ae8a-671aaaab368c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1641 microversion: 2.1 time: 0.184436 Sep 05 14:39:30.952314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 289/598] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1641 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:30.957653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:30.958376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:30.965091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.965838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.966474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:30.967444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:30.968098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:30.968977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:31.137339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:31.150325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:31.152456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:31.162630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f79bb3ad-80c8-4d7e-84e6-cb248e09bcf1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1750 microversion: 2.20 time: 0.239318 Sep 05 14:39:31.163180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 310/599] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1750 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:31.188471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:31.193806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:31.194414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:31.196179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-da07c6ae-cf2a-411b-81a6-916ebde2e2b9 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1468 microversion: 2.1 time: 0.241915 Sep 05 14:39:31.197303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 290/600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:30 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1468 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:31.215646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:31.216134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:31.216656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:31.217521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:31.218147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:31.219021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:31.295026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:31.299053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=5,nova_cell1:UPDATE=6 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:31.305378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-62cc0699-723f-404f-ac0f-0d745918fa4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1194 microversion: 2.1 time: 0.115682 Sep 05 14:39:31.307383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 311/601] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1194 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:31.379176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "41291c5c-98b5-40a9-bf43-3fd81fcb369e"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:31.382187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:31.390139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:31.390899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:31.391823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:31.392761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:31.393439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:31.394027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.181614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:32.182131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:32.190229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:32.190721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:32.191192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.192045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:32.192502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:32.192930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.431472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:32.443193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:32.444900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:32.446062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d85b2806-c63d-4416-bbde-6d755faa43aa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1752 microversion: 2.20 time: 0.268992 Sep 05 14:39:32.446777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 312/602] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1752 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:32.451440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:32.452202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:32.459119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:32.460513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:32.461116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.461986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:32.462599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:32.464549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.466512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:32.505141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:32.613128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-830d6a48-491f-48d0-adc3-32fd46b3169b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.390733 Sep 05 14:39:32.613794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 291/603] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:39:31 2022] POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 194 bytes in 1393 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:32.656005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:32.659749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:32.671735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:32.672411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:32.673533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.678608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:32.679330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:32.679941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:32.879053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:32.889155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-89b51176-8158-4ed5-8c00-4b6cf2087b5d tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1468 microversion: 2.1 time: 0.441110 Sep 05 14:39:32.889932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 313/604] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:32 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1468 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:33.033149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:33.039571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-360debae-5740-49a1-b0ab-1bd01521c9ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1272 microversion: 2.1 time: 0.424322 Sep 05 14:39:33.040278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 292/605] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1272 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:33.158358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-64d0dbd7-f004-4f5f-b635-ba13edc8b087 req-ade18785-6ae4-427c-a0ae-1e32e715d3b1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0921c73a-ed22-41a2-b38f-78c587836bb0", "tag": "5adb0041-9b7d-4fe6-9f1c-cb637443eb6e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:33.163518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:33.168858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-64d0dbd7-f004-4f5f-b635-ba13edc8b087 req-ade18785-6ae4-427c-a0ae-1e32e715d3b1 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.169529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-64d0dbd7-f004-4f5f-b635-ba13edc8b087 req-ade18785-6ae4-427c-a0ae-1e32e715d3b1 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.170128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-64d0dbd7-f004-4f5f-b635-ba13edc8b087 req-ade18785-6ae4-427c-a0ae-1e32e715d3b1 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.183043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-64d0dbd7-f004-4f5f-b635-ba13edc8b087 req-ade18785-6ae4-427c-a0ae-1e32e715d3b1 service nova] Creating event network-changed:5adb0041-9b7d-4fe6-9f1c-cb637443eb6e for instance 0921c73a-ed22-41a2-b38f-78c587836bb0 on hv-cinder-84290 Sep 05 14:39:33.188479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-64d0dbd7-f004-4f5f-b635-ba13edc8b087 req-ade18785-6ae4-427c-a0ae-1e32e715d3b1 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033902 Sep 05 14:39:33.189266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 314/606] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:33.294760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-5f6ccf37-2978-4c0e-bcf7-7a7af6c29c20 req-a5385001-a13e-4144-9ad9-b5a23867d408 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ae52220-4b49-437e-95f7-89116100fa1b", "name": "network-vif-deleted", "tag": "099fdff0-0e7a-40fc-90d0-c3801e017d98"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:33.305379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-5f6ccf37-2978-4c0e-bcf7-7a7af6c29c20 req-a5385001-a13e-4144-9ad9-b5a23867d408 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.305849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-5f6ccf37-2978-4c0e-bcf7-7a7af6c29c20 req-a5385001-a13e-4144-9ad9-b5a23867d408 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.306275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-5f6ccf37-2978-4c0e-bcf7-7a7af6c29c20 req-a5385001-a13e-4144-9ad9-b5a23867d408 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.318428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-5f6ccf37-2978-4c0e-bcf7-7a7af6c29c20 req-a5385001-a13e-4144-9ad9-b5a23867d408 service nova] Creating event network-vif-deleted:099fdff0-0e7a-40fc-90d0-c3801e017d98 for instance 8ae52220-4b49-437e-95f7-89116100fa1b on hv-cinder-84290 Sep 05 14:39:33.325242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-5f6ccf37-2978-4c0e-bcf7-7a7af6c29c20 req-a5385001-a13e-4144-9ad9-b5a23867d408 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034099 Sep 05 14:39:33.326094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 293/607] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:33.482949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:33.482949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:33.484911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.485595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.485797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.486510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.487145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.487792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.631141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:33.640465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:33.643997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:33.643997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-344caeed-5d10-407f-8ace-8aa62a099a42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1752 microversion: 2.20 time: 0.170511 Sep 05 14:39:33.643997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 315/608] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1752 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:33.913918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:33.915203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:33.922666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.923453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.923931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.924633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.925135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.925557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.959672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:33.960143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:33.960573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:33.961011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lazy-loading 'fault' on Instance uuid 8ae52220-4b49-437e-95f7-89116100fa1b {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:39:34.009807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:34.018489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1f44ead0-ac1a-45e6-99ad-a98bea0675b1 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1304 microversion: 2.1 time: 0.108751 Sep 05 14:39:34.019154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 294/609] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:33 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:34.064253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:34.064873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:34.071253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:34.072157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:34.072157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:34.072966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:34.073636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:34.074072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:34.212668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:34.221308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6466431-1b1f-40cb-b5c9-ec1793598368 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.161150 Sep 05 14:39:34.221862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 316/610] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:34.669386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:34.670054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:34.677264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:34.677729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:34.678168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:34.678926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:34.679370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:34.679793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:34.813426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:34.823429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:34.824890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:34.826090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2939aa6-640a-41ac-950e-a36397bd0729 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1752 microversion: 2.20 time: 0.160840 Sep 05 14:39:34.826622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 295/611] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:35.043203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:35.043814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:35.049856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.050338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.050768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.051473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.051925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.052347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.082726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.083237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.083670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.084110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lazy-loading 'fault' on Instance uuid 8ae52220-4b49-437e-95f7-89116100fa1b {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:39:35.126197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:35.134831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7cb1ed0d-481a-44db-a18f-fd2965848710 tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1304 microversion: 2.1 time: 0.095787 Sep 05 14:39:35.140800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 317/612] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:35 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:35.244164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:35.244777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:35.251952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.252433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.252887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.253613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.254119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.254535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.391028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:35.398679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7fc6e277-5094-40b4-ab65-3bb48d753e01 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.158437 Sep 05 14:39:35.399264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 296/613] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:35.852336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:35.852992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:35.860068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.860605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.860986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.861673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:35.862128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:35.862544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:35.990901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:35.999798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:36.001442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:36.002597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4d77b05-e0c7-4cb0-8da9-717f8b8a3082 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1752 microversion: 2.20 time: 0.154204 Sep 05 14:39:36.007175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 318/614] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1752 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:36.159249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:36.159856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:36.165732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:36.166230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:36.166666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:36.167393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:36.167842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:36.168281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:36.199929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:36.200307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:36.200738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:36.201185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lazy-loading 'fault' on Instance uuid 8ae52220-4b49-437e-95f7-89116100fa1b {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:39:36.243090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53398ecdd31e447ea317eeeaa78a0927', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '56deac6e76ee41f38fd2ca1f5a6536ec', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:36.250518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a6be141b-181d-412e-8eca-c26174bef44e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 200 len: 1304 microversion: 2.1 time: 0.095791 Sep 05 14:39:36.251478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 297/615] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:36 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:36.421041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:36.424308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:36.427842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:36.428325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:36.428781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:36.429445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:36.429897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:36.430317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:36.565495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:36.573333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a9ff39d-9555-4ad0-a4c2-f8401e3b802d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.156128 Sep 05 14:39:36.573922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 319/616] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:37.027873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:37.028407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:37.034992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:37.035491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:37.035908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:37.036598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:37.037145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:37.037474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:37.041587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:37.190448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:37.199165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:37.200616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:37.201787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-72483c42-75c4-4808-95a6-ce054a3f3521 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.177865 Sep 05 14:39:37.202864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 298/617] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:37.273174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:37.273777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] [instance: 8ae52220-4b49-437e-95f7-89116100fa1b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:37.279898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:37.280316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:37.281407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:37.282088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:37.282533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:37.282988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:37.296278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] HTTP exception thrown: Instance 8ae52220-4b49-437e-95f7-89116100fa1b could not be found. Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Request method failure captured: Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b HTTP/1.1 Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgoJHhJ0teoOpzWZTbUYOr366-HNZgG_bsMoB3xTY8PJEsEjpCC8cp2sIp9827jUxAOV7sd7W7t9tQNB2-c9c01wi4oz4OyrX-b3g2bojhciJZIfCk4X6pfC-xxXUPVBvzsgWJXSuHVqfOS9x81DI1pSZYi1QLnDmtJqUT1bGK5vW-4 Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 56deac6e76ee41f38fd2ca1f5a6536ec Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesNegativeTest-154220057 Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:39:37.297886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56deac6e76ee41f38fd2ca1f5a6536ec"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/56deac6e76ee41f38fd2ca1f5a6536ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/56deac6e76ee41f38fd2ca1f5a6536ec"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_56deac6e76ee41f38fd2ca1f5a6536ec"}]}] Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesNegativeTest-154220057 Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 56deac6e76ee41f38fd2ca1f5a6536ec Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesNegativeTest-154220057 Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesNegativeTest-154220057-project Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 53398ecdd31e447ea317eeeaa78a0927 Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesNegativeTest-154220057-project Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 8ae52220-4b49-437e-95f7-89116100fa1b could not be found. Sep 05 14:39:37.299595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '8ae52220-4b49-437e-95f7-89116100fa1b'} Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8ae52220-4b49-437e-95f7-89116100fa1b could not be found. Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:39:37.300637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8ae52220-4b49-437e-95f7-89116100fa1b could not be found. Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8ae52220-4b49-437e-95f7-89116100fa1b could not be found. Sep 05 14:39:37.302165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:39:37.303360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] Returning 404 to user: Instance 8ae52220-4b49-437e-95f7-89116100fa1b could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:39:37.303360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6fecde8b-b91b-4fae-afac-878307f68c7e tempest-VolumesNegativeTest-154220057 tempest-VolumesNegativeTest-154220057-project] 10.222.0.15 "GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b" status: 404 len: 111 microversion: 2.1 time: 0.029923 Sep 05 14:39:37.303360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 320/618] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:37 2022] GET /compute/v2.1/servers/8ae52220-4b49-437e-95f7-89116100fa1b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:39:37.597499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:37.598164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:37.604194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:37.604689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:37.605131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:37.605835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:37.606288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:37.606712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:37.758184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:37.767050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1ef10499-8917-417b-a6f5-d02d6b693097 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.174117 Sep 05 14:39:37.767722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 299/619] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:38.228360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:38.229166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:38.242170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:38.242170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:38.242170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:38.242170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:38.242713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:38.242713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:38.380338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:38.389193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:38.391233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:38.392476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-17ca5cbf-cbfb-49c6-882d-3c77bf454964 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.168287 Sep 05 14:39:38.393405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 321/620] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:38.791734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:38.792539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:38.800422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:38.801272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:38.802163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:38.803489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:38.804210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:38.804708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:38.957047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:38.965101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96c875fa-677d-41c0-871b-1c09fdce8b51 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.179522 Sep 05 14:39:38.965678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 300/621] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:38 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:39.418302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:39.418931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:39.424312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:39.427521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:39.428003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:39.428467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:39.429154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:39.429604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:39.430023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:39.572978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:39.582626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:39.584701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:39.585938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-de591fdf-4b1e-4af4-b091-172d1615ab39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.171547 Sep 05 14:39:39.586963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 322/622] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:39.989656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:39.990265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:39.997013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:39.997495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:39.997927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:39.998616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:39.999471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:39.999636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:40.160519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:40.170530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d305e726-a607-4881-a43b-53973e350f2c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.184625 Sep 05 14:39:40.176912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 301/623] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:40.613109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:40.613713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:40.620768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:40.621245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:40.621677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:40.622365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:40.622869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:40.623292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:40.774478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:40.783524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:40.785134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:40.786360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ade9d084-47c6-4309-b82c-206f08275bae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.177091 Sep 05 14:39:40.786973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 323/624] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:41.193262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:41.194559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:41.200763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:41.201332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:41.202057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:41.203459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:41.204075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:41.204683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:41.369036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:41.378387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e261ae6a-1733-4735-aa9b-140e5780eb9d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.188897 Sep 05 14:39:41.379066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 302/625] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:41.813858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:41.814585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:41.824951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:41.825443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:41.825878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:41.830620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:41.831116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:41.831554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:41.984250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:42.005820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:42.007335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:42.008719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fbf5b453-95a3-4b16-b6bc-526176427f32 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.199584 Sep 05 14:39:42.009278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 324/626] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:42.407286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:42.408541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:42.415428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:42.415917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:42.416350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:42.417053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:42.417506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:42.417984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:42.562044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:42.570150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d9fee7d0-4544-47a6-9381-48fcca1d8431 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.167247 Sep 05 14:39:42.571152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 303/627] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:43.034525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:43.036075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:43.043302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:43.043800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:43.044239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:43.044945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:43.045403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:43.045910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:43.186025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:43.194965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:43.196457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:43.197844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c60ac04b-ea0f-4a08-8d81-35c52db12b8d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.168162 Sep 05 14:39:43.198563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 325/628] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:43.594339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:43.594961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:43.601395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:43.601871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:43.602296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:43.603002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:43.603448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:43.603864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:43.748857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:43.764070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8d558b98-1cac-45e4-9226-ea5a9a5dc0c0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.174334 Sep 05 14:39:43.765556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 304/629] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:44.224243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:44.224887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:44.231645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:44.232133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:44.232563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:44.233519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:44.233977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:44.234396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:44.387769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:44.396491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:44.397997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:44.399331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3a229267-d246-4c53-9f01-0aa03dd56e86 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.179148 Sep 05 14:39:44.399909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 326/630] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:44.787769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:44.788600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:44.801581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:44.802174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:44.802593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:44.803336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:44.803793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:44.804213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:44.949620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:44.958388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fa6a5618-8775-4ccc-adcf-2c06215795ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.174530 Sep 05 14:39:44.959982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 305/631] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:45.425761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:45.426345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:45.432863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:45.433302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:45.433685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:45.434374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:45.434844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:45.435366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:45.602127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:45.613492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:45.628912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:45.628912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4697767b-2ee3-4941-b6f4-d211e5049759 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.204900 Sep 05 14:39:45.628912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 327/632] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:45.982271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:45.982998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:45.989595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:45.990053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:45.990481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:45.991208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:45.991643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:45.992062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:46.159516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:46.167652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-61bafa0c-916f-4389-8762-93e842f07f1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.189239 Sep 05 14:39:46.168478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 306/633] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:45 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:46.653361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:46.654057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:46.661406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:46.662007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:46.662470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:46.666826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:46.666826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:46.666826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:46.849832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:46.858883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:46.860316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:46.861491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8a6d4c5a-58e9-48e4-a22c-a35d23d5fb0a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.212050 Sep 05 14:39:46.862053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 328/634] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:47.191114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:47.191837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:47.198470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:47.199072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:47.199580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:47.200372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:47.201056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:47.201675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:47.342587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:47.351806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2ac46b9-2770-4f51-a850-673dd37125c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.165154 Sep 05 14:39:47.354586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 307/635] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:47.889375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:47.941207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:47.941207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:47.941207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:47.941207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:47.942222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:47.942222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:47.942222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:47.942222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:48.081327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:48.091085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:48.093369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:48.095065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6e94985f-d1bc-4f92-b225-37efe1da627f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.209575 Sep 05 14:39:48.096298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 329/636] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:48.375735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:48.376428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:48.382837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:48.383322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:48.383754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:48.384440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:48.384888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:48.385309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:48.537060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:48.549236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-39bc93df-18d8-471d-9c15-ba0cbf87fcbd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.174675 Sep 05 14:39:48.560881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 308/637] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:49.122182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:49.122947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:49.130001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:49.130988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:49.131421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:49.132119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:49.132758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:49.133179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:49.268655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:49.277944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:49.279472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:49.281341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b8062204-0ad1-47bd-b952-1c806bd1568a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.164083 Sep 05 14:39:49.282077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 330/638] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:49.568289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:49.568906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:49.575305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:49.575783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:49.576207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:49.576879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:49.577323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:49.577737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:49.709353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:49.717283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8f60cd70-3317-47f3-a334-1fd6460e8eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.152806 Sep 05 14:39:49.717894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 309/639] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:50.307556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:50.308185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:50.315498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:50.315970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:50.316397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:50.317068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:50.317512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:50.317926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:50.448322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:50.456913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:50.460392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:50.460392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cfb5ad8b-7947-47a6-a849-d6e96d0fcbfe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.155872 Sep 05 14:39:50.460392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 331/640] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:50.740432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:50.741037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:50.747370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:50.747845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:50.748273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:50.748998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:50.749450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:50.749864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:50.877997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:50.885834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ffb8e378-1e85-4c18-a364-cc3276de140f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.149287 Sep 05 14:39:50.886384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 310/641] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:50.986334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1408541637", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "networks": [{"uuid": "66a2245b-c726-4c55-9119-b3dc61cb9c80"}]}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:51.039672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] validate_networks() for [('66a2245b-c726-4c55-9119-b3dc61cb9c80', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:39:51.423831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:39:51.424346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:39:51.424697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:39:51.425130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:39:51.425532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:39:51.434815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:51.435336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:51.435764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:51.436988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:51.437435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:51.437852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:51.454382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Getting quotas for project f60d54b7dc874a8080159b81aafc89d5. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:39:51.458259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Getting quotas for user dac33ec33c26411d9dcf8c3bbea7a9e9 and project f60d54b7dc874a8080159b81aafc89d5. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:39:51.468856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:39:51.471364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:39:51.485503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:51.486116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:51.488042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:51.492797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:51.493360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:51.493766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:51.494455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:51.494937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:51.497773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:51.626831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:51.635269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:51.636752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:51.638407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0ffb4b9c-0e7d-4c45-b106-f93a12e12d03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.156876 Sep 05 14:39:51.638998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 311/642] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:51.647266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1f1c256-f107-4041-9640-4ba7b1f7ed7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.664776 Sep 05 14:39:51.647909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 332/643] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:39:51.660637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ec1273ff-4192-4884-8071-0ed874d76e8e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:51.661394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ec1273ff-4192-4884-8071-0ed874d76e8e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:51.715862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ec1273ff-4192-4884-8071-0ed874d76e8e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:51.723052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ec1273ff-4192-4884-8071-0ed874d76e8e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1219 microversion: 2.1 time: 0.066653 Sep 05 14:39:51.723623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 312/644] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:51 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:51.910589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:51.911148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:51.917132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:51.917610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:51.918041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:51.918728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:51.919207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:51.919631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:52.047547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:52.055354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-691cfd71-e58d-4cb9-8046-1ba8407f50ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.149785 Sep 05 14:39:52.055917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 333/645] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:52.668348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:52.668949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:52.675338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:52.675817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:52.676251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:52.676936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:52.677391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:52.677812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:52.749129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:52.749941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:52.756908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:52.759323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:52.759817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:52.760562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:52.761028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:52.761453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:52.835021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:52.838391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:52.843440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a482d6e7-7e02-4138-8b67-a1e33d1cefa5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1223 microversion: 2.1 time: 0.099922 Sep 05 14:39:52.850280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 334/646] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:52 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:52.850519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:52.850519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:52.850519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9d65bc09-519d-4024-8a30-f7a634dc1eb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.186195 Sep 05 14:39:52.851034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 313/647] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:53.090497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:53.091070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:53.097902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:53.098387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:53.098855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:53.099554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:53.100011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:53.100433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:53.236180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:53.243689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b7a509d-d051-426f-ba00-f093e6290bd0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.157057 Sep 05 14:39:53.244245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 335/648] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:53.866059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:53.866660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:53.873330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:53.873815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:53.874752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:53.875482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:53.875933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:53.876354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:53.876506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:53.877117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:53.883672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:53.884148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:53.884578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:53.885258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:53.885706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:53.886124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:53.965997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:53.974059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ddab1620-1538-4bdf-a327-b20fce260eb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1223 microversion: 2.1 time: 0.111852 Sep 05 14:39:53.974970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 314/649] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:53 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1223 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:54.041573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:54.050294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:54.051749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:54.052935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-68e5a592-aa39-4901-81cf-afe9ce157a6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.180779 Sep 05 14:39:54.053480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 336/650] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:54.266266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:54.268729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:54.275625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:54.276289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:54.276828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:54.277745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:54.278463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:54.279069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:54.415372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:54.418853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:39:54.423323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-937817de-0fac-4c0f-a7f6-edb1065fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.161664 Sep 05 14:39:54.423892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 315/651] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:54.997515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:54.998064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:55.005294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:55.005780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:55.006204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:55.006913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:55.007357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:55.007773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:55.075646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:55.077620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:55.078059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:55.084406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9220d4aa-c50c-4775-8a6b-8527fa256d8c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1223 microversion: 2.1 time: 0.091051 Sep 05 14:39:55.084978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 337/652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:54 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:55.085120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:55.085512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:55.085951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:55.086652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:55.087140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:55.087565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:55.215480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:55.224819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:55.226262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:55.227458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ccd41e4b-244f-4687-8b24-b4d8e8a3349e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.153874 Sep 05 14:39:55.228016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 316/653] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:39:55.445437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:55.446038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:55.452009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:55.453126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:55.453126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:55.454073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:55.454533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:55.455020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:55.588403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:55.597039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b681139c-47c5-47c3-a498-7d4c68e5221b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.155494 Sep 05 14:39:55.597602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 338/654] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:56.116354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:56.116354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:56.116354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.116354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.117186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.117478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.117933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.118355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.186251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:56.198901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c67cc1d3-a751-4bc7-9bce-ce1ae5f906a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1271 microversion: 2.1 time: 0.092916 Sep 05 14:39:56.198901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 317/655] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:56 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1271 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:56.253068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:56.253706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:56.260080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.260562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.261000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.261685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.262137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.262561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.403240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:56.412724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:56.414241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:56.415726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-192fc8b1-bea5-4b0b-82f5-f7a0e42ac21d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.167053 Sep 05 14:39:56.416272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 339/656] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:56.474559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:56.476886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:56.482932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.483398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.483833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.484510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.484951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.485365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.507056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'flavor' on Instance uuid 6dc3d4fd-7509-404c-af29-824137cd6af4 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:39:56.619353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:56.619884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:56.626393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.626905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.627340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.628023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.628474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.628896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.760534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:56.768782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7f02ab7c-40ae-4f44-9ca6-ef08e60beadf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.153309 Sep 05 14:39:56.769340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 340/657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:56.946201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-569a5cce-dcb4-4d08-9c95-c2832abcc7ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/action" status: 200 len: 32 microversion: 2.1 time: 0.475513 Sep 05 14:39:56.946860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 318/658] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:39:56 2022] POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/action => generated 32 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 05 14:39:56.956229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:56.957259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:56.962933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.963560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.963855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:56.964566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:56.965006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:56.965452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.220810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:57.221657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:57.239401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.240053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.240593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.241426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.241982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.242507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.350588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:57.358851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-54d09254-7f19-47f7-b83e-e5061f0f52e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1279 microversion: 2.1 time: 0.142422 Sep 05 14:39:57.359662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 319/659] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:57 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:57.364537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-f7b261d1-d98a-48ba-a277-af020a244f68 req-352868cd-8ecc-4682-a09c-3e3f2babe2d3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0921c73a-ed22-41a2-b38f-78c587836bb0", "name": "network-vif-plugged", "status": "completed", "tag": "5adb0041-9b7d-4fe6-9f1c-cb637443eb6e"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:57.376662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f7b261d1-d98a-48ba-a277-af020a244f68 req-352868cd-8ecc-4682-a09c-3e3f2babe2d3 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.377374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f7b261d1-d98a-48ba-a277-af020a244f68 req-352868cd-8ecc-4682-a09c-3e3f2babe2d3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.377964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f7b261d1-d98a-48ba-a277-af020a244f68 req-352868cd-8ecc-4682-a09c-3e3f2babe2d3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.392397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-f7b261d1-d98a-48ba-a277-af020a244f68 req-352868cd-8ecc-4682-a09c-3e3f2babe2d3 service nova] Creating event network-vif-plugged:5adb0041-9b7d-4fe6-9f1c-cb637443eb6e for instance 0921c73a-ed22-41a2-b38f-78c587836bb0 on hv-cinder-84290 Sep 05 14:39:57.399085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-f7b261d1-d98a-48ba-a277-af020a244f68 req-352868cd-8ecc-4682-a09c-3e3f2babe2d3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037689 Sep 05 14:39:57.399701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 320/660] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:57.404513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:57.412853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90e15f04-2598-4989-a240-4fd1e088d4cb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.460425 Sep 05 14:39:57.413434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 341/661] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:57.446160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:57.446886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:57.455390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.456283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.456882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.457882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.459031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.459698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.682823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:57.695539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:57.697301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:57.698662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c8160924-2ed0-4485-b5ea-f3b29443ce02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.257116 Sep 05 14:39:57.714827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 321/662] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:57.793557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:57.794249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:57.803154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.803649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.804081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:57.804778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:57.805426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:57.805847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.085140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:58.099134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3fa826ff-0170-46a5-99f0-408926020b5e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.311200 Sep 05 14:39:58.099720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 342/663] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:58.382816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:58.383344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:58.390404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:58.391015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:58.395020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.395020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:58.395020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:58.395020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.435945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:58.437462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:58.444206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:58.444693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:58.445132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.447812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:58.448291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:58.448763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.558742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:58.567488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d3353854-fd5e-47e1-add7-ad99b84f8c60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.188575 Sep 05 14:39:58.568097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 322/664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:58 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:58.606851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:58.615412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ac326c99-d644-4a44-9040-27d457aaa25d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.183362 Sep 05 14:39:58.615983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 343/665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:58.725463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:58.726068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:58.732040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:58.732524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:58.732959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.734164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:58.734613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:58.735073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:58.864393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:58.873009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:58.874451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:58.875645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6c343fa1-72c7-4d9a-9ee4-dcb0fe291b25 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.154120 Sep 05 14:39:58.876201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 323/666] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:39:59.121504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:59.122240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:59.128794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.129299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.129731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.130415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.130894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.131317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.260599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:59.268816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-242e7420-1b28-453b-a66e-b9033f59f26b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.151247 Sep 05 14:39:59.273649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 344/667] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:59 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:59.500421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-403b3e2e-f5ae-4f4b-af36-94b3524e43a0 req-1f9163b0-63fb-4439-b427-45adf57e4f0e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38c0cc71-00b5-4788-b7a4-844b9654da72", "tag": "15f3aa31-95c2-4325-8f88-cfe055a26bf9"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:39:59.509719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-403b3e2e-f5ae-4f4b-af36-94b3524e43a0 req-1f9163b0-63fb-4439-b427-45adf57e4f0e service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.510191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-403b3e2e-f5ae-4f4b-af36-94b3524e43a0 req-1f9163b0-63fb-4439-b427-45adf57e4f0e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.510622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-403b3e2e-f5ae-4f4b-af36-94b3524e43a0 req-1f9163b0-63fb-4439-b427-45adf57e4f0e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.521779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-403b3e2e-f5ae-4f4b-af36-94b3524e43a0 req-1f9163b0-63fb-4439-b427-45adf57e4f0e service nova] Creating event network-changed:15f3aa31-95c2-4325-8f88-cfe055a26bf9 for instance 38c0cc71-00b5-4788-b7a4-844b9654da72 on hv-cinder-84290 Sep 05 14:39:59.526346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-403b3e2e-f5ae-4f4b-af36-94b3524e43a0 req-1f9163b0-63fb-4439-b427-45adf57e4f0e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149446 Sep 05 14:39:59.526952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 324/668] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:39:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:39:59.590365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:59.591006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:59.597660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.598144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.598579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.599297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.599753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.600173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.640244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:59.640964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:59.648709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.649492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.649925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.650650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.651125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.652168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.780098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:59.787727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6da98730-4154-4545-8441-7dde9a6ef5a9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.201212 Sep 05 14:39:59.788298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 345/669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:59 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:39:59.808496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:39:59.817003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0498da4a-9667-4143-8fbb-9594c519a2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.181834 Sep 05 14:39:59.817552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 325/670] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:39:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:39:59.900579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:39:59.901182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:39:59.907078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.907558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.907994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:39:59.908680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:39:59.909129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:39:59.909550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:00.039298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:00.042666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:00.048583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:00.051010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:00.051229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-60e04964-dbe4-4f70-94b6-e7a61f403edc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.154434 Sep 05 14:40:00.051791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 346/671] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:39:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:00.292295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:00.292861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:00.298737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:00.299245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:00.299704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:00.300386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:00.300836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:00.301257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:00.433439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:00.443024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ad1fdcd3-625d-4786-8efa-80163b66f7e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1260 microversion: 2.1 time: 0.154627 Sep 05 14:40:00.443852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 326/672] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:00.810401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:00.811013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:00.818342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:00.818837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:00.819267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:00.820377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:00.820837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:00.821254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:00.840645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:00.841236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:00.847308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:00.847787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:00.848217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:00.848897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:00.849343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:00.849756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.016258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.023723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.024212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-47947d19-013a-4c4a-b37e-671327fa3e9d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.217774 Sep 05 14:40:01.024791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 347/673] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:00 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:01.032731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-36eb9443-a7af-426c-9c90-ba237141cfdd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.195988 Sep 05 14:40:01.033278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 327/674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:01.076359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:01.077007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:01.083093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:01.083633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:01.084065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.084743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:01.085190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:01.085606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.210416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.219598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.221019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.222156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e40e57c4-e9d5-4037-a7f5-3833ccca8f01 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.149689 Sep 05 14:40:01.222714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 348/675] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:01.466583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:01.467220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:01.474443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:01.474952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:01.475379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.476054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:01.476503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:01.476947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.608930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.616568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-99dda222-7f45-4d63-95c3-3ffdb73de0c8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1445 microversion: 2.1 time: 0.153769 Sep 05 14:40:01.617125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 328/676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1445 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:01.637976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:01.638586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:01.641023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:01.641688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=6 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:01.646322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:01.646809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:01.647295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.647976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:01.648442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:01.648876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:01.778423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:01.786802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-008bfb96-a1c8-41a1-b15b-e162879861b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1445 microversion: 2.1 time: 0.152608 Sep 05 14:40:01.787370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 349/677] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1445 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:02.046834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:02.047447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:02.049452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:02.054222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:02.054707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:02.055211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:02.055904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:02.056355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:02.056784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:02.057500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:02.058305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:02.065921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:02.066742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:02.067331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:02.068134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:02.068693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:02.069214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:02.347447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:02.355118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a524c1d8-5767-4ebd-afa6-dec4afd72687 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.312181 Sep 05 14:40:02.355691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 329/678] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:02 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:02.366973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:02.366973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:02.367370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:02.371524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0da24b58-1aef-4d32-ac29-d76fddb82786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.318080 Sep 05 14:40:02.373207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:02.373704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:02.374811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:02.375518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:02.376843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:02.377284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:02.383042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 350/679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:02.581912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:02.590825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:02.592280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:02.594020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d9f5ae98-ab2f-4df4-8f3b-557cca48ad57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.237377 Sep 05 14:40:02.595061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 330/680] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:03.379844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:03.380450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:03.387028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:03.387553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:03.387988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:03.388742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:03.389199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:03.390266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:03.394598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:03.395269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:03.401199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:03.401685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:03.402118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:03.402817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:03.403275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:03.403700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:03.919603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:03.928358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cbe4acf1-4c55-42a5-9768-57423cc3e3c4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.552397 Sep 05 14:40:03.929239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 351/681] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:03 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:03.933499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:03.936712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:03.940143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:03.940624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:03.941053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:03.941793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:03.942244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:03.942661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:03.955023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:03.958993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:03.968777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dccb51df-7746-40c9-9697-ff6801318af4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.577104 Sep 05 14:40:03.970119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 331/682] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:04.203517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:04.212231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:04.213661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:04.214877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5253dbbe-89b4-4409-8582-0229e1fc7abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.284874 Sep 05 14:40:04.215502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 352/683] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:04.567043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-fbd636dc-8c80-42b9-9f8d-0756f0ae108d req-3ef3fda6-4de0-45a4-824d-eb2f0f46bbb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0921c73a-ed22-41a2-b38f-78c587836bb0", "tag": "5adb0041-9b7d-4fe6-9f1c-cb637443eb6e"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:04.576390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-fbd636dc-8c80-42b9-9f8d-0756f0ae108d req-3ef3fda6-4de0-45a4-824d-eb2f0f46bbb7 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:04.576895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-fbd636dc-8c80-42b9-9f8d-0756f0ae108d req-3ef3fda6-4de0-45a4-824d-eb2f0f46bbb7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:04.577333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-fbd636dc-8c80-42b9-9f8d-0756f0ae108d req-3ef3fda6-4de0-45a4-824d-eb2f0f46bbb7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:04.588968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-fbd636dc-8c80-42b9-9f8d-0756f0ae108d req-3ef3fda6-4de0-45a4-824d-eb2f0f46bbb7 service nova] Creating event network-changed:5adb0041-9b7d-4fe6-9f1c-cb637443eb6e for instance 0921c73a-ed22-41a2-b38f-78c587836bb0 on hv-cinder-84290 Sep 05 14:40:04.593975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-fbd636dc-8c80-42b9-9f8d-0756f0ae108d req-3ef3fda6-4de0-45a4-824d-eb2f0f46bbb7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084361 Sep 05 14:40:04.594851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 332/684] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:04.953979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:04.954583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:04.961359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:04.961839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:04.962273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:04.963194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:04.964017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:04.964452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:04.993183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:04.993794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:05.000316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:05.000805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:05.001494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:05.002411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:05.003082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:05.003719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:05.267215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:05.279472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-80091b4c-6a33-448f-b646-9d4c7d102d30 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.329321 Sep 05 14:40:05.281486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 353/685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:04 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:05.291948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:05.292927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:05.306769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:05.309666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:05.310325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:05.310502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:05.311346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:05.313781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:05.314646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:05.324523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53e8cc51-862e-43d1-8c0e-08344b31b114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.335420 Sep 05 14:40:05.326632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 333/686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:05.553934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:05.563198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:05.567654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:05.567654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-76805a7b-7053-4091-b682-d1e642f7e3d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.282481 Sep 05 14:40:05.567654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 354/687] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:06.303053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:06.303692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:06.310231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:06.310739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:06.311225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:06.311887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:06.312337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:06.312759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:06.350993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:06.351836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:06.358109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:06.359245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:06.359709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:06.360467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:06.360870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:06.361292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:06.502212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:06.509699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1506607f-8309-46a3-88db-b62ef393387e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.210502 Sep 05 14:40:06.510269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 334/688] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:06 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:06.531691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:06.539929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3a5a00bb-fc6b-46f6-ad7b-9bfc6580dcaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.192860 Sep 05 14:40:06.540477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 355/689] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:06.591759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:06.592370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:06.599110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:06.599545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:06.599983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:06.600675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:06.601131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:06.601560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:06.730207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:06.738920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:06.740361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:06.741524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-89147972-c922-4f85-b032-f09e7abe1cd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.153825 Sep 05 14:40:06.742102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 335/690] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:07.532152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:07.538447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:07.539534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.540013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.540443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.541123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.541573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.541989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.564017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:07.565382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:07.572391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.573004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.573448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.574177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.574636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.575300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.731684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:07.740299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e94d0f22-c527-4196-94f2-802de98ea608 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.212101 Sep 05 14:40:07.741074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 356/691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:07 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:07.760972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:07.771539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6e2519fe-fc49-4568-8b1c-9c7e664e4418 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212025 Sep 05 14:40:07.787134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 336/692] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:07.792622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:07.793257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:07.802203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.802203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.802203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.802203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.802551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.802551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.831075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-ed502e59-65ac-4118-8766-5829ff5a231b req-0c3a4bf3-db32-400d-966b-2a9c276b6b3e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c0cc71-00b5-4788-b7a4-844b9654da72", "name": "network-vif-plugged", "status": "completed", "tag": "15f3aa31-95c2-4325-8f88-cfe055a26bf9"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:07.841097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ed502e59-65ac-4118-8766-5829ff5a231b req-0c3a4bf3-db32-400d-966b-2a9c276b6b3e service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:07.841833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ed502e59-65ac-4118-8766-5829ff5a231b req-0c3a4bf3-db32-400d-966b-2a9c276b6b3e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:07.842322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ed502e59-65ac-4118-8766-5829ff5a231b req-0c3a4bf3-db32-400d-966b-2a9c276b6b3e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:07.855461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-ed502e59-65ac-4118-8766-5829ff5a231b req-0c3a4bf3-db32-400d-966b-2a9c276b6b3e service nova] Creating event network-vif-plugged:15f3aa31-95c2-4325-8f88-cfe055a26bf9 for instance 38c0cc71-00b5-4788-b7a4-844b9654da72 on hv-cinder-84290 Sep 05 14:40:07.861413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-ed502e59-65ac-4118-8766-5829ff5a231b req-0c3a4bf3-db32-400d-966b-2a9c276b6b3e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109209 Sep 05 14:40:07.862639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 357/693] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:07.938073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:07.946911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:07.948429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:07.949612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-63b76321-d817-490c-90be-e4b484aaf3f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.161321 Sep 05 14:40:07.950196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 337/694] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:08.767762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:08.768456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:08.775031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:08.775508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:08.776063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:08.776749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:08.777202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:08.777703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:08.796569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:08.797170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:08.803508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:08.803984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:08.804413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:08.805096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:08.805540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:08.805953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:08.978065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:08.982026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:08.986210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8408f3e6-653c-46e9-bd35-3b2ffdca75bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.223341 Sep 05 14:40:08.986803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 358/695] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:08 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:08.990689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f6eb0d48-74d7-4859-96f8-dae0af116a1a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.197875 Sep 05 14:40:08.991270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 338/696] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:08.991576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:08.992245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:08.998310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:08.999373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:09.000147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:09.000844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:09.001303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:09.001728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:09.138771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:09.147318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:09.148760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:09.149906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3d18333b-576f-44fe-9be6-d6968e1dbfe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.161894 Sep 05 14:40:09.150460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 359/697] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:09.877498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-63979756-b62a-4671-b3cd-14d3ca060ff1 req-9983a014-9a89-4d78-90ef-ef48d4189090 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "name": "network-vif-plugged", "status": "completed", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:09.887434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-63979756-b62a-4671-b3cd-14d3ca060ff1 req-9983a014-9a89-4d78-90ef-ef48d4189090 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:09.887910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-63979756-b62a-4671-b3cd-14d3ca060ff1 req-9983a014-9a89-4d78-90ef-ef48d4189090 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:09.888363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-63979756-b62a-4671-b3cd-14d3ca060ff1 req-9983a014-9a89-4d78-90ef-ef48d4189090 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:09.898975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-63979756-b62a-4671-b3cd-14d3ca060ff1 req-9983a014-9a89-4d78-90ef-ef48d4189090 service nova] Creating event network-vif-plugged:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:40:09.904013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-63979756-b62a-4671-b3cd-14d3ca060ff1 req-9983a014-9a89-4d78-90ef-ef48d4189090 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030941 Sep 05 14:40:09.904693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 339/698] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:10.009775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:10.010465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:10.014612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:10.015334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:10.017238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:10.017736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:10.018191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:10.019165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:10.019663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:10.020092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:10.021674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:10.022263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:10.022879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:10.023563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:10.024011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:10.024430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:10.215027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:10.218243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:10.223934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96601738-b9be-44c4-9686-9d7667635860 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1319 microversion: 2.1 time: 0.217805 Sep 05 14:40:10.232895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 360/699] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:10 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1319 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:10.232895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:10.232895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:10.236065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-51a8d7ef-42e6-46c5-b88b-8edaca27f47f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.225479 Sep 05 14:40:10.236626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 340/700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:10.236984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:10.237604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:10.238043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:10.238875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:10.239358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:10.239782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:10.366672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:10.375184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:10.376614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:10.377750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ebc7960-1077-48be-b968-a2eee4e8b0a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.151640 Sep 05 14:40:10.378305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 361/701] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:11.248228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:11.248840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:11.255289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:11.255771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:11.256205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:11.256892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:11.257349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:11.257769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:11.258473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:11.259106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:11.261495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:11.266890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:11.267380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:11.267841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:11.268566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:11.269022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:11.269446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:11.452389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:11.456717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:11.460604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-30ecd301-0925-4ee4-9cb6-aaa783724c62 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1509 microversion: 2.1 time: 0.216277 Sep 05 14:40:11.461168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 341/702] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:11 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1509 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:11.471040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b72d1d4a-a454-43ea-869d-9619e32d6d49 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.210475 Sep 05 14:40:11.471177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:11.471296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 362/703] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:11.471393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:11.472657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:11.473137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:11.473566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:11.474245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:11.474708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:11.475136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:11.608745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:11.617437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:11.618840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:11.620008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b0d1e1af-9c03-422d-bd5c-f84209173a22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.157931 Sep 05 14:40:11.626989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 342/704] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:12.489948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:12.490548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:12.496991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:12.497470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:12.497898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:12.498581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:12.499075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:12.499481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:12.627042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:12.635595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d55def93-e73d-4cc8-8889-2601217ee916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149462 Sep 05 14:40:12.636149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 363/705] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:12.645875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:12.646484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:12.653310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:12.653870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:12.654311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:12.655046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:12.655501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:12.655933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:12.791646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:12.800135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:12.801559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:12.802700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-66067b9e-1846-4884-8779-49a7d0334451 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.160716 Sep 05 14:40:12.803289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 343/706] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:13.659456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:13.659975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:13.666449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:13.666966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:13.667399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:13.668081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:13.668537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:13.668959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:13.672956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:13.801733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:13.809922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3755b7e-1ab9-4ad0-aed5-d5f2e4fe684e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.154959 Sep 05 14:40:13.810486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 364/707] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:13.826859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:13.827468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:13.834077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:13.834548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:13.835024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:13.835699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:13.836145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:13.836560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:13.972033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:13.980860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:13.982489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:13.983675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1137918f-e81d-495e-b4d2-91aa27ccb464 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.160790 Sep 05 14:40:13.984812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 344/708] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:14.833602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:14.834207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:14.840651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:14.841131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:14.841565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:14.842245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:14.842699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:14.843150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:14.977423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:14.986295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6acc146-bc07-4fae-a944-bb8b8b129301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.156512 Sep 05 14:40:14.986808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 365/709] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:15.009340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:15.009938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:15.016302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:15.016773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:15.017201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:15.017879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:15.018322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:15.018738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:15.154033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:15.163228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:15.164651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:15.165797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b1869ccc-f348-40d0-a4d8-3b4f5a7ea9f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.160346 Sep 05 14:40:15.166340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 345/710] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:16.009594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:16.010201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:16.016890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.017314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.017746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.018424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.018904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.019329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.149500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:16.158179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88643fbf-00d6-4726-9a78-7bec866d8e13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1715 microversion: 2.1 time: 0.152592 Sep 05 14:40:16.158738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 366/711] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1715 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:16.191383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:16.191990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:16.198520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.199040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.199473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.200158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.200610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.201040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.278072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:16.279155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:16.287533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.288590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.289101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.289893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.290425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.290957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.342167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:16.351593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:16.353032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:16.354195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ebb2009d-18ba-425b-a252-03a89d3c2b3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.166697 Sep 05 14:40:16.354755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 346/712] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:16.417349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] HTTP exception thrown: Cannot 'detach_volume' instance 6dc3d4fd-7509-404c-af29-824137cd6af4 while it is in vm_state rescued Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Request method failure captured: Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments/41291c5c-98b5-40a9-bf43-3fd81fcb369e HTTP/1.1 Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjvME7A0Oa-XHElvBJnAvhVALXYUKaCZry8Wznb1X8cZXgDmXzbJDt9GmasZp9dLO_bm1vCuWtDApCkJtVFPWhKFkqyEVbSIm1wLc1Mtto0I-3DysC1-aaIbYKyu1Ki3RBx4vPz8Qoy023vk1pa6_17adNlOqGIo-hAh9LW1U_N3do Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:40:16.419013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2af009055e3b4bdda73a770242253b0d"}]}] Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 9136f02e6c664f27b3f4fd35475f0eea Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:40:16.420661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Cannot 'detach_volume' instance 6dc3d4fd-7509-404c-af29-824137cd6af4 while it is in vm_state rescued Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'server_id': '6dc3d4fd-7509-404c-af29-824137cd6af4', 'id': '41291c5c-98b5-40a9-bf43-3fd81fcb369e'} Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6dc3d4fd-7509-404c-af29-824137cd6af4 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:40:16.421466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6dc3d4fd-7509-404c-af29-824137cd6af4 while it is in vm_state rescued Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6dc3d4fd-7509-404c-af29-824137cd6af4 while it is in vm_state rescued Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:16.422853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Returning 409 to user: Cannot 'detach_volume' instance 6dc3d4fd-7509-404c-af29-824137cd6af4 while it is in vm_state rescued {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:40:16.423892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-465e924e-ff62-4ebd-8f98-797cb4334aa8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments/41291c5c-98b5-40a9-bf43-3fd81fcb369e" status: 409 len: 152 microversion: 2.1 time: 0.147140 Sep 05 14:40:16.423892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 367/713] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:40:16 2022] DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments/41291c5c-98b5-40a9-bf43-3fd81fcb369e => generated 152 bytes in 148 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 05 14:40:16.431826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:16.432522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:16.444064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.444559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.444996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.445691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.446141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.446556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.694311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ef6b2d9-a142-4f8d-b6fd-dbe01cf94c98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/action" status: 202 len: 0 microversion: 2.1 time: 0.268462 Sep 05 14:40:16.694965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 347/714] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:40:16 2022] POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 14:40:16.703555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:16.704164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:16.711173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.711667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.712100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.712827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:16.713282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:16.713733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:16.844022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:16.854444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9af684e7-c69b-40b4-a6a9-86a293cf3609 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1723 microversion: 2.1 time: 0.155128 Sep 05 14:40:16.855066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 368/715] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:17.382273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:17.382911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:17.388986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:17.389463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:17.389895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:17.390604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:17.391078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:17.391506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:17.521814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:17.525310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:17.530706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:17.532675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:17.533827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c7fc2ad3-9e27-467e-bfca-3f206a0a5707 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.156447 Sep 05 14:40:17.534373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 348/716] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:40:17.877471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:17.878074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:17.884451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:17.884928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:17.885354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:17.886031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:17.886478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:17.886925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:18.017514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:18.026815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-117be234-718a-417a-a3cc-629b27ee671d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1723 microversion: 2.1 time: 0.153088 Sep 05 14:40:18.027574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 369/717] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:18.560945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:18.561527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:18.572077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:18.576879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:18.576879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:18.576879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:18.576879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:18.577275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:18.725432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:18.734645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:18.736133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:18.737305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-62f35a85-7822-400e-a94e-9b967f59eb33 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.181074 Sep 05 14:40:18.737863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 349/718] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:19.051245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:19.051860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:19.058259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:19.058741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:19.059619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:19.060330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:19.060785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:19.061210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:19.197868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:19.206146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cdc07748-8e3a-4010-9518-b651d695a96d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1723 microversion: 2.1 time: 0.159584 Sep 05 14:40:19.206708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 370/719] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:19.764489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:19.765096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:19.772292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:19.772777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:19.773211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:19.773922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:19.774381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:19.774834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:19.905685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:19.914617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:19.916012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:19.917162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e09d3c64-872b-4910-b563-06a132c00354 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.156612 Sep 05 14:40:19.917710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 350/720] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:20.229303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:20.229901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:20.236786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:20.237256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:20.237685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:20.238358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:20.238820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:20.239241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:20.370489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:20.379255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ea2bf79a-1758-4de8-94e9-99bdbaa650ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1723 microversion: 2.1 time: 0.153692 Sep 05 14:40:20.379814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 371/721] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:20.942705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:20.943337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:20.949607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:20.950079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:20.950505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:20.951207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:20.951653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:20.952070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:21.083331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:21.091829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:21.093247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:21.095293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5350e8fa-9e46-48e1-8fb2-da68837c9b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1808 microversion: 2.20 time: 0.156449 Sep 05 14:40:21.100902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 351/722] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:21.403626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:21.404245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:21.411768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:21.412912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:21.413633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:21.414595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:21.415312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:21.415838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:21.543412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:21.551464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f028c070-30f1-49cf-b724-f504f8b9a6a6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1723 microversion: 2.1 time: 0.153025 Sep 05 14:40:21.552029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 372/723] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:22.120943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:22.122929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:22.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=84 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:22.128738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:22.129243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:22.129673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:22.130379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:22.130849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:22.131269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:22.260356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:22.268902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:22.270324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:22.271490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-14ea3278-2fca-4116-9e46-22c2ead0d3fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1795 microversion: 2.20 time: 0.154539 Sep 05 14:40:22.272048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 352/724] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:40:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1795 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:40:22.575143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:22.575727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:22.582656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:22.583163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:22.583615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:22.584274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:22.584739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:22.585136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:22.721584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:22.722143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-30ea7798-40d0-467b-9816-cdfb54ddaf83 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1729 microversion: 2.1 time: 0.150807 Sep 05 14:40:22.722709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 373/725] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1729 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:22.745350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:22.745755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:22.752470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:22.752961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:22.753398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:22.754095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:22.754581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:22.755042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:22.837942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9ce0adc1-0a2c-4a32-b78c-161cbd1fd909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096555 Sep 05 14:40:22.838528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 353/726] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 14:40:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:24.036936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-d23eb829-99c2-4392-9301-6237a1990c6f req-dc06c7a0-fb22-49ad-9143-e9eae1b84a4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:24.048483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-d23eb829-99c2-4392-9301-6237a1990c6f req-dc06c7a0-fb22-49ad-9143-e9eae1b84a4d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:24.050028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-d23eb829-99c2-4392-9301-6237a1990c6f req-dc06c7a0-fb22-49ad-9143-e9eae1b84a4d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:24.050028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-d23eb829-99c2-4392-9301-6237a1990c6f req-dc06c7a0-fb22-49ad-9143-e9eae1b84a4d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:24.060963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-d23eb829-99c2-4392-9301-6237a1990c6f req-dc06c7a0-fb22-49ad-9143-e9eae1b84a4d service nova] Creating event network-changed:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 14:40:24.067258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-d23eb829-99c2-4392-9301-6237a1990c6f req-dc06c7a0-fb22-49ad-9143-e9eae1b84a4d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034121 Sep 05 14:40:24.067909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 374/727] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:25.197228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:25.197731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:25.204312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.204786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.205216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.205897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.206381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.206836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.229605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-328dffb5-ef65-4a6e-ab6d-5d3551aa1901 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/ips" status: 200 len: 149 microversion: 2.1 time: 0.134111 Sep 05 14:40:25.230388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 354/728] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:40:25 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/ips => generated 149 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:25.242743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "412c19b3-8b68-476e-8b33-f673f20ba56f"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:25.245342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:25.251698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.252178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.252679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.253281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.253756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.254130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.332102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Invalid volume: volume 412c19b3-8b68-476e-8b33-f673f20ba56f is already attached to instances: 57a94776-abef-42ea-a633-c70dedfdacab Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: POST /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/os-volume_attachments HTTP/1.1 Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 74 Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:40:25.333822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {"volumeAttachment": {"volumeId": "412c19b3-8b68-476e-8b33-f673f20ba56f"}} Sep 05 14:40:25.335629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Invalid volume: volume 412c19b3-8b68-476e-8b33-f673f20ba56f is already attached to instances: 57a94776-abef-42ea-a633-c70dedfdacab Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'server_id': '8135d8b8-fc8e-404c-a3d2-90595028a8bf', 'body': {'volumeAttachment': {'volumeId': '412c19b3-8b68-476e-8b33-f673f20ba56f'}}} Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 412c19b3-8b68-476e-8b33-f673f20ba56f is already attached to instances: 57a94776-abef-42ea-a633-c70dedfdacab Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:25.336574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 412c19b3-8b68-476e-8b33-f673f20ba56f is already attached to instances: 57a94776-abef-42ea-a633-c70dedfdacab Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:25.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 412c19b3-8b68-476e-8b33-f673f20ba56f is already attached to instances: 57a94776-abef-42ea-a633-c70dedfdacab Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 400 to user: Invalid volume: volume 412c19b3-8b68-476e-8b33-f673f20ba56f is already attached to instances: 57a94776-abef-42ea-a633-c70dedfdacab {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ba8f1ed-0ae6-4ee6-9a18-8e09e808f770 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097290 Sep 05 14:40:25.339689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 375/729] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:40:25 2022] POST /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 14:40:25.344197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:25.344957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:25.350870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.351350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.351783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.352468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.352917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.353341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.377602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:40:25.770522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e3476e07-41a4-445a-947f-e104c8fc4942 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 204 len: 0 microversion: 2.1 time: 0.429777 Sep 05 14:40:25.771059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 355/730] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:40:25 2022] DELETE /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 14:40:25.779218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:25.784824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:25.786980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.787467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.787902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.788590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:25.789075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:25.789502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:25.916458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:25.924656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b357d7a0-b672-488d-b9ae-1d081281e045 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1679 microversion: 2.1 time: 0.149303 Sep 05 14:40:25.925216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 376/731] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:25 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1679 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:26.084484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-715fa71d-98f0-4e25-a409-54652a89268c req-58b6d596-2803-41a1-aa84-4402a8d0486f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:26.095769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-715fa71d-98f0-4e25-a409-54652a89268c req-58b6d596-2803-41a1-aa84-4402a8d0486f service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:26.096245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-715fa71d-98f0-4e25-a409-54652a89268c req-58b6d596-2803-41a1-aa84-4402a8d0486f service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:26.096668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-715fa71d-98f0-4e25-a409-54652a89268c req-58b6d596-2803-41a1-aa84-4402a8d0486f service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:26.107987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-715fa71d-98f0-4e25-a409-54652a89268c req-58b6d596-2803-41a1-aa84-4402a8d0486f service nova] Creating event network-changed:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 14:40:26.113621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-715fa71d-98f0-4e25-a409-54652a89268c req-58b6d596-2803-41a1-aa84-4402a8d0486f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033170 Sep 05 14:40:26.114194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 356/732] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:26.946459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:26.947099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:26.953540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:26.954023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:26.954456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:26.955169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:26.955622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:26.956043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:27.089769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:27.096624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2e30d055-11ce-463e-b174-74d16f03b7a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1679 microversion: 2.1 time: 0.153902 Sep 05 14:40:27.097268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 377/733] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:26 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1679 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:28.121621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:28.122328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:28.129677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:28.130160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:28.130593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:28.131313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:28.131771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:28.132193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:28.302962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:28.314283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6b2d4fb3-7a6d-4e09-b7aa-2e2066ee78f0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1679 microversion: 2.1 time: 0.196716 Sep 05 14:40:28.315087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 357/734] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:28 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1679 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:29.258378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-74602d20-9d4f-4d01-ba9c-ce350a88cdeb req-166a4c62-275b-400c-983d-eb08c061a1bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8135d8b8-fc8e-404c-a3d2-90595028a8bf", "name": "network-vif-deleted", "tag": "b6e63722-ab5f-4e8a-a5a1-256e8465473b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:29.267991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-74602d20-9d4f-4d01-ba9c-ce350a88cdeb req-166a4c62-275b-400c-983d-eb08c061a1bf service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:29.270331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-74602d20-9d4f-4d01-ba9c-ce350a88cdeb req-166a4c62-275b-400c-983d-eb08c061a1bf service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:29.270331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-74602d20-9d4f-4d01-ba9c-ce350a88cdeb req-166a4c62-275b-400c-983d-eb08c061a1bf service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:29.279992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-74602d20-9d4f-4d01-ba9c-ce350a88cdeb req-166a4c62-275b-400c-983d-eb08c061a1bf service nova] Creating event network-vif-deleted:b6e63722-ab5f-4e8a-a5a1-256e8465473b for instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf on hv-cinder-84290 Sep 05 14:40:29.285220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-74602d20-9d4f-4d01-ba9c-ce350a88cdeb req-166a4c62-275b-400c-983d-eb08c061a1bf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030397 Sep 05 14:40:29.285809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 378/735] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:29.338104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:29.338857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:29.347036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:29.347555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:29.347996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:29.348731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:29.349158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:29.349745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:29.420117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:29.428854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fc48fa58-70f2-4ee4-b599-d8688ac66530 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1614 microversion: 2.1 time: 0.094807 Sep 05 14:40:29.429591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 358/736] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:29 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1614 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:30.455834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:30.456472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:30.467116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:30.467706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:30.468017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:30.468733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:30.469416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:30.470173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:30.503756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:30.504288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:30.504835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:30.505391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lazy-loading 'fault' on Instance uuid 8135d8b8-fc8e-404c-a3d2-90595028a8bf {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:40:30.551142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:30.558880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2788896e-3f43-4f4a-9523-3f609cceb0d3 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 200 len: 1332 microversion: 2.1 time: 0.108789 Sep 05 14:40:30.559623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 379/737] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:30 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 1332 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:31.583003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:31.583666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:31.590081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:31.590559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:31.591042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:31.591757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:31.592209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:31.592631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:31.606627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf HTTP/1.1 Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:40:31.608285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 14:40:31.609865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '8135d8b8-fc8e-404c-a3d2-90595028a8bf'} Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:40:31.610690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 14:40:31.611974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:40:31.613117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:40:31.613117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7903b51f-0f4b-4990-abf5-c9250881db1c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 404 len: 111 microversion: 2.1 time: 0.030590 Sep 05 14:40:31.613117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 359/738] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:31 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:40:31.618349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c70d4e66-7157-4712-bf4f-a5edcf0a4969 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '.version_select at 0x7fb194c38820>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:31.703631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c70d4e66-7157-4712-bf4f-a5edcf0a4969 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587200949" status: 202 len: 0 microversion: 2.1 time: 0.088299 Sep 05 14:40:31.704101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 380/739] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 5 14:40:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587200949 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:40:32.520522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:32.521213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:32.527717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:32.529919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:32.530436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:32.531906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:32.532441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:32.532982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:32.659087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lazy-loading 'services' on Instance uuid 57a94776-abef-42ea-a633-c70dedfdacab {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:40:32.895741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83829247-0d55-438d-a568-3b3aad1cfc99 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments/412c19b3-8b68-476e-8b33-f673f20ba56f" status: 202 len: 0 microversion: 2.1 time: 0.378930 Sep 05 14:40:32.896274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 360/740] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:40:32 2022] DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments/412c19b3-8b68-476e-8b33-f673f20ba56f => generated 0 bytes in 380 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:40:32.905297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:32.909628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:32.918478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:32.919012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:32.921038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:32.921866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:32.922363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:32.922818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:32.952492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48b62499-1762-497b-83a8-b3efccd24eb6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051732 Sep 05 14:40:32.953550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 381/741] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:40:32 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:33.966275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:33.969521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:33.976570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:33.977128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:33.977565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:33.978246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:33.978743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:33.979184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:34.008835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-63b7d23d-335d-435c-b572-230f60ed6e7f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047386 Sep 05 14:40:34.016007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 361/742] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:40:33 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:35.021084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:35.023306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:35.029628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:35.030106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:35.030540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:35.031767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:35.032219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:35.032639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:35.057237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:35.061347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8b56bd18-c0c8-430a-9c70-75d9f6564999 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044315 Sep 05 14:40:35.061891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 382/743] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:40:35 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 14:40:35.128689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:35.129212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:35.135646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:35.136127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:35.136560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:35.137240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:35.137692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:35.138112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:35.166694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:40:35.467172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8affe595-ea12-491a-a631-ecb09c4d77e5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 204 len: 0 microversion: 2.1 time: 0.342048 Sep 05 14:40:35.467790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 362/744] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:40:35 2022] DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 0 bytes in 344 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:40:35.476898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:35.477503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:35.484110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:35.484443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:35.484789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:35.485522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:35.485976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:35.486400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:35.614455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:35.622140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-476c559a-ca68-4bf4-a875-66eac97de9d1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1680 microversion: 2.1 time: 0.149055 Sep 05 14:40:35.622695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 383/745] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:35 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1680 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:36.646458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:36.647122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:36.653398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:36.653870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:36.654303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:36.655032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:36.655479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:36.656466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:36.673922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:36.789086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:36.796769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-416e2637-2c14-4555-a319-742e27f416bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1680 microversion: 2.1 time: 0.154610 Sep 05 14:40:36.797323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 363/746] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:36 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:37.651030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "004e1e63-be0d-4352-b374-75bf7fb59e6b", "device": "/dev/sdb"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:37.653831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:37.660264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:37.660735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:37.661163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:37.661845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:37.662287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:37.662753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:37.819682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:37.820292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:37.826878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:37.827361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:37.827813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:37.828498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:37.828945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:37.829364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:37.914729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:37.923032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc1c3a48-a5f9-48c2-b514-05ceaa568bb2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1613 microversion: 2.1 time: 0.107175 Sep 05 14:40:37.923592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 364/747] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:37 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1613 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:38.028637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-83dc2ddc-4e8e-4db8-8f15-026f9680ccdf req-24794c2e-b284-4178-b114-2a195c15a213 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57a94776-abef-42ea-a633-c70dedfdacab", "name": "network-vif-deleted", "tag": "c898cf19-a336-4343-9ccc-5bdb6f2eb060"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:38.039887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-83dc2ddc-4e8e-4db8-8f15-026f9680ccdf req-24794c2e-b284-4178-b114-2a195c15a213 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:38.040370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-83dc2ddc-4e8e-4db8-8f15-026f9680ccdf req-24794c2e-b284-4178-b114-2a195c15a213 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:38.040793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-83dc2ddc-4e8e-4db8-8f15-026f9680ccdf req-24794c2e-b284-4178-b114-2a195c15a213 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:38.052728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-83dc2ddc-4e8e-4db8-8f15-026f9680ccdf req-24794c2e-b284-4178-b114-2a195c15a213 service nova] Creating event network-vif-deleted:c898cf19-a336-4343-9ccc-5bdb6f2eb060 for instance 57a94776-abef-42ea-a633-c70dedfdacab on hv-cinder-84290 Sep 05 14:40:38.057727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-83dc2ddc-4e8e-4db8-8f15-026f9680ccdf req-24794c2e-b284-4178-b114-2a195c15a213 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032701 Sep 05 14:40:38.058333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 365/748] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:38.598005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-61d32a87-5ee6-43a0-93e0-0982851e4cae tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "POST /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.950782 Sep 05 14:40:38.598550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 384/749] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:40:37 2022] POST /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72/os-volume_attachments => generated 194 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:38.949130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:38.950949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:38.957436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:38.963587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:38.963587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:38.963587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:38.963587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:38.963986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:38.992479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:38.992954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:38.997932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:38.997932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lazy-loading 'fault' on Instance uuid 57a94776-abef-42ea-a633-c70dedfdacab {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:40:39.035117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:39.042893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c6b216ac-e854-4589-9c62-17e7f0bca5ca tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 200 len: 1331 microversion: 2.1 time: 0.099871 Sep 05 14:40:39.043449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 366/750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:38 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 1331 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:40.066527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:40.067240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:40.073795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:40.074275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:40.074704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:40.075413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:40.075858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:40.076272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:40.090910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab HTTP/1.1 Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:40:40.092555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 14:40:40.095481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '57a94776-abef-42ea-a633-c70dedfdacab'} Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:40:40.096412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 14:40:40.097876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:40:40.099657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:40:40.099657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dd6f3804-8b30-4527-aa82-b3da7f014d41 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 404 len: 111 microversion: 2.1 time: 0.032660 Sep 05 14:40:40.099657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 385/751] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:40 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:40:40.103566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-43d18d54-6378-4810-a017-70c61748c3f8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '.version_select at 0x7fb19155a040>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:40.182262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-43d18d54-6378-4810-a017-70c61748c3f8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-403777729" status: 202 len: 0 microversion: 2.1 time: 0.082352 Sep 05 14:40:40.182779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 367/752] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Sep 5 14:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-403777729 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:40:40.941045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fc802b9d-a0f5-4d3b-a003-a5ae05a40e18 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: .version_select at 0x7fb194d183a0>, body: {"keypair": {"name": "tempest-keypair-1920009078", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEYRv2vXXA6H6Jm+Ztjt2sir+umBjfIE0Gedv3LZrJQ3WCC+RwINjVWA8H3o3Cv0v283qRqwx/RrRMULwYGDqxllgET+ht5HT2Q95ISKPUixZcfjjUikWI7xDf5qIjGEug=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:40.956730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-fc802b9d-a0f5-4d3b-a003-a5ae05a40e18 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:40:40.960504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-fc802b9d-a0f5-4d3b-a003-a5ae05a40e18 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:40:41.038736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fc802b9d-a0f5-4d3b-a003-a5ae05a40e18 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.101954 Sep 05 14:40:41.039285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 386/753] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:40:40 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:43.339361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-892295315", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b1d20ee-7dc0-477b-93a5-81201fa15bc2"}], "security_groups": [{"name": "tempest-securitygroup--138869003"}], "key_name": "tempest-keypair-1920009078", "user_data": "}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:43.442043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] validate_networks() for [('6b1d20ee-7dc0-477b-93a5-81201fa15bc2', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:40:44.064662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:40:44.064662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:40:44.064662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:40:44.064662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:40:44.064662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:40:44.073865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:44.074346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:44.074842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:44.075544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:44.076069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:44.076487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:44.098602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:40:44.102573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:40:44.114136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:40:44.116459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:40:44.235417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d3be8617-fd1c-4d5b-8beb-e881a6fc34d6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.900975 Sep 05 14:40:44.236081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 368/754] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:40:43 2022] POST /compute/v2.1/servers => generated 401 bytes in 902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:40:44.247811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7ac2778b-6263-41a9-b67f-dc13261ceacb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:44.248514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7ac2778b-6263-41a9-b67f-dc13261ceacb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:44.250493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:44.308032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7ac2778b-6263-41a9-b67f-dc13261ceacb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:44.314973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7ac2778b-6263-41a9-b67f-dc13261ceacb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1241 microversion: 2.1 time: 0.071670 Sep 05 14:40:44.315852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 387/755] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:44 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1241 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:45.338007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:45.338713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:45.345671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:45.346151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:45.346585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:45.347292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:45.347879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:45.348257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:45.410437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:45.418007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-42476c1e-c509-4fe0-bd46-0a656c74225b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1245 microversion: 2.1 time: 0.083897 Sep 05 14:40:45.418567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 369/756] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:45 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:46.440313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:46.441021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:46.448332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:46.448962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:46.449319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:46.450034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:46.450491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:46.450953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:46.513730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:46.521914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8fecd828-a536-4d1d-8226-eadec40e3dd6 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1293 microversion: 2.1 time: 0.085456 Sep 05 14:40:46.522463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 388/757] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:46 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1293 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:47.548908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:47.549591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:47.556128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:47.556610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:47.557044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:47.557728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:47.558178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:47.558595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:47.644463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:47.652284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ddc89743-2ea1-4cc2-ba4e-9fcfaf65cb86 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1311 microversion: 2.1 time: 0.107860 Sep 05 14:40:47.653078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 370/758] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:47 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1311 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:48.676777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:48.677579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:48.684350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:48.684835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:48.685268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:48.685963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:48.686418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:48.687613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:48.872506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:48.881247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c197296-1a81-4b35-b46a-685c14171fb9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.208453 Sep 05 14:40:48.881962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 389/759] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:48 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:49.204145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-71859365-717b-41fc-a940-5f050fbd316d req-e55dbc9c-4dd7-4bb6-88e1-a779722669c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a", "tag": "4541f3e1-3407-4781-bb22-67bf97299fc8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:49.214160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-71859365-717b-41fc-a940-5f050fbd316d req-e55dbc9c-4dd7-4bb6-88e1-a779722669c0 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:49.214636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-71859365-717b-41fc-a940-5f050fbd316d req-e55dbc9c-4dd7-4bb6-88e1-a779722669c0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:49.215108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-71859365-717b-41fc-a940-5f050fbd316d req-e55dbc9c-4dd7-4bb6-88e1-a779722669c0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:49.226586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-71859365-717b-41fc-a940-5f050fbd316d req-e55dbc9c-4dd7-4bb6-88e1-a779722669c0 service nova] Creating event network-changed:4541f3e1-3407-4781-bb22-67bf97299fc8 for instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a on hv-cinder-84290 Sep 05 14:40:49.231307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-71859365-717b-41fc-a940-5f050fbd316d req-e55dbc9c-4dd7-4bb6-88e1-a779722669c0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030910 Sep 05 14:40:49.231888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 371/760] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:40:49.903908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:49.904527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:49.911064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:49.911555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:49.911988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:49.912679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:49.913133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:49.913553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:50.042499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:50.050129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7acb93ec-65a0-4904-aa02-2569c87f1893 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.150043 Sep 05 14:40:50.050683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 390/761] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:49 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:51.073569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:51.074264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:51.081283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:51.081768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:51.082195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:51.083230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:51.083681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:51.084096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:51.215424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:51.223918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-67a51447-cac1-4acd-972c-ce00cc688a2e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.155045 Sep 05 14:40:51.224474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 372/762] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:51 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:52.246106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:52.246710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:52.253634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:52.254109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:52.254535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:52.255257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:52.255710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:52.256130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:52.380063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:52.387702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-18f1947a-c2bc-494d-a1c8-875016360e46 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.145481 Sep 05 14:40:52.388295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 391/763] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:52 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:53.411773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:53.412384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:53.414901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:53.419556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:53.420040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:53.420471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:53.421153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:53.421604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:53.422023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:53.551556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:53.559040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-34dfa50f-f3ed-4666-8ce2-f04517f32db5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.151173 Sep 05 14:40:53.559601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 373/764] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:53 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:53.841847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:40:53.844591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:53.851207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:53.851680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:53.852107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:53.852786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:53.853234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:53.853650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:54.123152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-703fbae9-a8fc-47a7-8a4e-5bb69d82de9e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action" status: 202 len: 0 microversion: 2.1 time: 0.285026 Sep 05 14:40:54.125518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 392/765] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:40:53 2022] POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:40:54.132005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:54.132609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:54.134427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:54.135122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:54.140470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:54.140951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:54.141377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:54.142054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:54.142501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:54.142961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:54.287702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:54.295836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d49bb354-588f-468e-a400-e58952abf0e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.167927 Sep 05 14:40:54.296388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 374/766] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:54.579834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=6 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:40:54.584007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:54.584793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:54.591008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:54.591493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:54.591934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:54.592618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:54.593071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:54.593492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:54.723790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:54.731418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c7202017-8543-4fd4-966c-3ba1b098f7a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.152821 Sep 05 14:40:54.733963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 393/767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:54 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:55.318814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:55.319343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:55.326393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:55.326901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:55.327333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:55.328010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:55.328457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:55.328875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:55.471640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:55.479682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-95f935f2-d410-431f-86bb-775b1478ebce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.164814 Sep 05 14:40:55.480240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 375/768] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:55.754990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:55.762589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:55.762589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:55.762589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:55.763008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:55.763441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:55.763890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:55.764309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:55.892467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:55.900034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3a1ddcf3-023e-47c1-97cf-97e1d0f58350 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.149026 Sep 05 14:40:55.900595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 394/769] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:55 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:40:56.502519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:56.503174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:56.509636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:56.510109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:56.510549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:56.511284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:56.511908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:56.512151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:56.652521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:56.661152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-27fbe19e-982f-4f34-9ab1-8f1866d08aa8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.162499 Sep 05 14:40:56.661708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 376/770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:56.923007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:56.923544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:56.929800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:56.930370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:56.930811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:56.931498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:56.931944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:56.932484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:57.063945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:57.071491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-51e4dbd6-3c27-42a0-a916-318059bb5534 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.152431 Sep 05 14:40:57.072053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 395/771] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:56 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:57.685165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:57.685803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:57.692788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:57.693265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:57.693695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:57.694371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:57.694850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:57.695275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:57.835508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:57.843719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8d6e35e8-66f5-40df-a8c7-87cec348ae25 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.162403 Sep 05 14:40:57.844277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 377/772] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:58.094645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:58.095533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:58.102469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:58.102996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:58.103431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:58.104157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:58.104652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:58.105074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:58.237801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:58.245346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e891f65-5b8e-4eb5-a44f-2b3e66f92496 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.154669 Sep 05 14:40:58.245905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 396/773] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:58 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:58.867650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:58.868181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:58.874542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:58.875056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:58.875491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:58.876177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:58.876630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:58.877053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:59.019547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:59.027741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-75bbe4ba-d541-4d9c-9f02-c8db15f493f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.164033 Sep 05 14:40:59.038400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 378/774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:40:59.267795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:40:59.268393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:40:59.274698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:59.275203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:59.275628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:59.276298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:40:59.276740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:40:59.277196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:40:59.404401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:40:59.411832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a67c8034-55e7-4e60-a209-1e9ad39624c9 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.147895 Sep 05 14:40:59.412385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 397/775] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:40:59 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:00.051085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:00.051693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:00.057995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:00.058471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:00.058946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:00.059631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:00.060077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:00.060493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:00.200174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:00.208984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6b05ffb4-106d-472f-9f2c-1afed317ab83 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.161812 Sep 05 14:41:00.209541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 379/776] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:00.435053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:00.435678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:00.442393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:00.442897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:00.443334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:00.444016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:00.444469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:00.444921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:00.572882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:00.580791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-add7db2a-6b54-4ec9-87a5-a8e420f5d87d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.149790 Sep 05 14:41:00.581397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 398/777] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:00 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:01.231990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:01.232607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:01.239895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:01.240372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:01.240800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:01.241481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:01.241996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:01.242415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:01.391153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:01.400195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a6b05305-8347-4871-bf27-3de8df0343a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.172166 Sep 05 14:41:01.400957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 380/778] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:01.603365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:01.604250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:01.610768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:01.611352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:01.611778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:01.612463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:01.612911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:01.613362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:01.799330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:01.802698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:01.807196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4169f936-415a-4bdd-8dd2-9a525a3c4615 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.207642 Sep 05 14:41:01.807783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 399/779] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:01 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:02.424552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:02.425108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:02.431417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:02.431896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:02.432324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:02.432997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:02.433442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:02.433855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:02.574083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:02.582204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ebcd018a-7cc9-4438-b0f3-feb685e4d0f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.162096 Sep 05 14:41:02.582799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 381/780] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:02.830902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:02.831489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:02.838403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:02.838910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:02.839344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:02.840026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:02.840477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:02.840894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:02.966262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:02.974746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4502a04c-45bb-4b91-88fd-2ef85388f0a5 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.148528 Sep 05 14:41:02.975345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 400/781] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:02 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:03.605358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:03.605956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:03.612763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:03.613238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:03.613670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:03.614347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:03.614814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:03.615263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:03.756698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:03.760054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:03.765025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-168cfcb1-0200-481f-9dee-2487f490d5b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.163531 Sep 05 14:41:03.765575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 382/782] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:03.996767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:03.997378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:04.003748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:04.004230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:04.004670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:04.005352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:04.005804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:04.006226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:04.140416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:04.148469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-03495158-e5cd-4f15-961e-bd786a8f077f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.155157 Sep 05 14:41:04.148626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 401/783] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:03 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:04.788669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:04.789217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:04.795682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:04.796157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:04.796585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:04.797263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:04.797709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:04.798126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:04.934502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:04.942607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f113bc6f-7b9b-469d-b841-e65ae8b21ca1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.158187 Sep 05 14:41:04.943195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 383/784] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:05.171324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:05.171938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:05.178396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:05.178908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:05.179347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:05.180061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:05.180518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:05.181227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:05.307825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:05.315453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1084dd19-60a1-4fd2-bcef-92ac2d19229e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.147999 Sep 05 14:41:05.316012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 402/785] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:05 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:05.965452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:05.966060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:05.972733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:05.973213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:05.973645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:05.974329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:05.974800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:05.975235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:06.114686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:06.122880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d234080-06a7-43df-861b-4739301608c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1751 microversion: 2.1 time: 0.161344 Sep 05 14:41:06.123448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 384/786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:06.338773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:06.339383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:06.346028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:06.346515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:06.346984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:06.348183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:06.348640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:06.349061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:06.482847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:06.491053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7e338cee-a494-4e17-86ac-d9a262cd2f48 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.156159 Sep 05 14:41:06.491621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 403/787] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:06 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:07.146672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:07.147303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:07.153929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:07.154400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:07.154851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:07.155531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:07.155975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:07.156390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:07.294865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:07.303488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d78d5ab8-8b53-4711-aef1-4eae2c9818af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.161275 Sep 05 14:41:07.304046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 385/788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:07.513403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:07.514051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:07.520411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:07.520892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:07.521329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:07.524206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:07.524206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:07.524206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:07.649038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:07.656627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-50d79c9d-84e9-4c62-a24b-0ff450964cd4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.147042 Sep 05 14:41:07.657190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 404/789] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:07 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:08.130576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-0f72467c-45f5-4492-901c-504938106830 req-222d7189-3a02-43cf-be8c-fc2fc6f0565f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a", "name": "network-vif-plugged", "status": "completed", "tag": "4541f3e1-3407-4781-bb22-67bf97299fc8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:08.139952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0f72467c-45f5-4492-901c-504938106830 req-222d7189-3a02-43cf-be8c-fc2fc6f0565f service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:08.140431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0f72467c-45f5-4492-901c-504938106830 req-222d7189-3a02-43cf-be8c-fc2fc6f0565f service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:08.140875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-0f72467c-45f5-4492-901c-504938106830 req-222d7189-3a02-43cf-be8c-fc2fc6f0565f service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:08.152938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-0f72467c-45f5-4492-901c-504938106830 req-222d7189-3a02-43cf-be8c-fc2fc6f0565f service nova] Creating event network-vif-plugged:4541f3e1-3407-4781-bb22-67bf97299fc8 for instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a on hv-cinder-84290 Sep 05 14:41:08.157889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-0f72467c-45f5-4492-901c-504938106830 req-222d7189-3a02-43cf-be8c-fc2fc6f0565f service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030992 Sep 05 14:41:08.163022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 386/790] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:41:08.328826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:08.328826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:08.335578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:08.336039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:08.336462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:08.337143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:08.337592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:08.338006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:08.481919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:08.490246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c347bf50-2e53-4246-9134-219490cbbfe3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.167176 Sep 05 14:41:08.490861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 405/791] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:08.681813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:08.682657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:08.689234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:08.689868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:08.690309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:08.691042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:08.692072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:08.692702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:08.827084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:08.834716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b8b2227e-5ab2-435f-9b14-109bc09d5b93 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.157637 Sep 05 14:41:08.840063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 387/792] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:08 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:09.513438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:09.514041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:09.520955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:09.521423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:09.521852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:09.522519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:09.522999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:09.523413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:09.661313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:09.669874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-30930b74-db37-4e3f-9c4d-aa1f81b61b2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.160337 Sep 05 14:41:09.670426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 406/793] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:09.858687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:09.859267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:09.865752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:09.866521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:09.866880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:09.867637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:09.868091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:09.868511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:09.999650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:10.008427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ead3dffe-d72a-4792-bc69-b278519a1bbc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.153758 Sep 05 14:41:10.009027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 388/794] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:09 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:10.692656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:10.693269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:10.699788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:10.702009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:10.702009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:10.702009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:10.702009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:10.702356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:10.841922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:10.850982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2a5e0289-a969-43e2-8a5c-1327d38d9e68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.162174 Sep 05 14:41:10.851552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 407/795] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:11.031982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:11.032509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:11.039438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:11.039914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:11.040337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:11.041010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:11.041468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:11.042045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:11.171149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:11.178820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c052ad60-900d-4a23-829e-f14801a09c1e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1366 microversion: 2.1 time: 0.150807 Sep 05 14:41:11.179385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 389/796] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:11 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:11.873608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:11.874279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:11.881290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:11.881774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:11.882207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:11.882909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:11.883363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:11.883782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:11.952389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:11.952911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:11.958773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:11.959290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:11.959725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:11.960412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:11.960863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:11.961283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:12.028585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:12.035882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1348446d-bced-4176-ac5a-fc16e9bc94c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.166081 Sep 05 14:41:12.036775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 408/797] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:12.043772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'services' on Instance uuid 38c0cc71-00b5-4788-b7a4-844b9654da72 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:41:12.203928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:12.204451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:12.211007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:12.211484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:12.211909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:12.212582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:12.213028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:12.213443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:12.287826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e4136f1d-b68c-426e-afd8-0c086438f402 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72/os-volume_attachments/004e1e63-be0d-4352-b374-75bf7fb59e6b" status: 202 len: 0 microversion: 2.1 time: 0.339262 Sep 05 14:41:12.288428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 390/798] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:41:11 2022] DELETE /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72/os-volume_attachments/004e1e63-be0d-4352-b374-75bf7fb59e6b => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 14:41:12.351841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:12.354986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7ca3a54c-c5f1-412e-9601-8501b3c4e2ec tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 200 len: 1555 microversion: 2.1 time: 0.155008 Sep 05 14:41:12.355539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 409/799] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:12 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 1555 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:41:12.387504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:12.388074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:12.394193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:12.395344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:12.395905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:12.396585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:12.397031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:12.397480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:12.484659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ca385ba-fb78-4a90-b445-4d091dceaca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101222 Sep 05 14:41:12.485251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 391/800] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 14:41:12 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:41:13.059867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:13.060481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:13.067245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:13.067751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:13.068164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:13.069212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:13.069738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:13.070170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:13.278229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:13.287026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a40be28-419a-4e5b-bd02-41cccca2393a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.231032 Sep 05 14:41:13.287660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 410/801] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:13.848757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-f24c4c48-2b9a-45b9-998a-adc6ae392cba req-ca665bb9-1dae-4862-8be4-f772af5db0ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a", "tag": "4541f3e1-3407-4781-bb22-67bf97299fc8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:13.858230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f24c4c48-2b9a-45b9-998a-adc6ae392cba req-ca665bb9-1dae-4862-8be4-f772af5db0ee service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:13.858704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f24c4c48-2b9a-45b9-998a-adc6ae392cba req-ca665bb9-1dae-4862-8be4-f772af5db0ee service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:13.859154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f24c4c48-2b9a-45b9-998a-adc6ae392cba req-ca665bb9-1dae-4862-8be4-f772af5db0ee service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:13.870128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-f24c4c48-2b9a-45b9-998a-adc6ae392cba req-ca665bb9-1dae-4862-8be4-f772af5db0ee service nova] Creating event network-changed:4541f3e1-3407-4781-bb22-67bf97299fc8 for instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a on hv-cinder-84290 Sep 05 14:41:13.875591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-f24c4c48-2b9a-45b9-998a-adc6ae392cba req-ca665bb9-1dae-4862-8be4-f772af5db0ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031154 Sep 05 14:41:13.876732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 392/802] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:41:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:41:14.311012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:14.311656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:14.319155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:14.319639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:14.320064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:14.320933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:14.321541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:14.322114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:14.485011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:14.485828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:14.492887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:14.493628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:14.494267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:14.494976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:14.495490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:14.495974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:14.525313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:41:14.541475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:14.550244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f61b44ae-0c8e-4ca9-8d69-4c46cdd4bcb4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.243210 Sep 05 14:41:14.558934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 411/803] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:14.942442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-664af791-82be-4dcf-9ffa-a9ee34529338 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 204 len: 0 microversion: 2.1 time: 0.460880 Sep 05 14:41:14.943053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 393/804] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:41:14 2022] DELETE /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 0 bytes in 463 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 14:41:14.951269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:14.951882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:14.957797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:14.964969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:14.964969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:14.964969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:14.964969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:14.965414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:15.097026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:15.105342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f2e99b2-a1e8-4338-a466-1f4d661aa3c1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1515 microversion: 2.1 time: 0.157892 Sep 05 14:41:15.105914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 412/805] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:14 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:15.578000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:15.578730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:15.585240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:15.585718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:15.586148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:15.586847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:15.587302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:15.587725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:15.727443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:15.735811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5b61a2b3-beaf-4118-b28b-fba8f7996d8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.162085 Sep 05 14:41:15.736371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 394/806] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:16.133936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:16.134537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:16.140541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:16.141016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:16.141447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:16.142121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:16.142567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:16.143017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:16.274705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:16.282377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8ede895f-822d-4784-8ce4-35a4b00402cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1515 microversion: 2.1 time: 0.157161 Sep 05 14:41:16.282960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 413/807] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:16 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:16.759479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:16.760694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:16.767170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:16.767609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:16.768041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:16.768730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:16.769182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:16.770252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:16.909030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:16.917046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae0ebdf8-1f7a-4f26-a495-d96db1cb3c68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.161478 Sep 05 14:41:16.917604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 395/808] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:17.306427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:17.307055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:17.313384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:17.313858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:17.314284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:17.315001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:17.315452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:17.315868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:17.516285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:17.523932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-76efc628-ef69-4a66-9e8b-91684fa79229 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1515 microversion: 2.1 time: 0.221521 Sep 05 14:41:17.524519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 414/809] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:17 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:17.935518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-c6a9e712-81d9-452b-abaf-4b1035eaf457 req-040bde9b-b39f-48ee-b107-a48deeb73819 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38c0cc71-00b5-4788-b7a4-844b9654da72", "name": "network-vif-deleted", "tag": "15f3aa31-95c2-4325-8f88-cfe055a26bf9"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:17.939747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:17.940485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:17.945919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c6a9e712-81d9-452b-abaf-4b1035eaf457 req-040bde9b-b39f-48ee-b107-a48deeb73819 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:17.948897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c6a9e712-81d9-452b-abaf-4b1035eaf457 req-040bde9b-b39f-48ee-b107-a48deeb73819 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:17.948897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-c6a9e712-81d9-452b-abaf-4b1035eaf457 req-040bde9b-b39f-48ee-b107-a48deeb73819 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:17.949142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:17.949142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:17.949142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:17.949142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:17.949488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:17.949488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:17.957809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-c6a9e712-81d9-452b-abaf-4b1035eaf457 req-040bde9b-b39f-48ee-b107-a48deeb73819 service nova] Creating event network-vif-deleted:15f3aa31-95c2-4325-8f88-cfe055a26bf9 for instance 38c0cc71-00b5-4788-b7a4-844b9654da72 on hv-cinder-84290 Sep 05 14:41:17.962675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-c6a9e712-81d9-452b-abaf-4b1035eaf457 req-040bde9b-b39f-48ee-b107-a48deeb73819 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030853 Sep 05 14:41:17.963339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 396/810] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:41:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:41:18.094321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:18.103238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-93ee74ee-951b-4525-b9ce-9aa732884dd2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.167322 Sep 05 14:41:18.103739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 415/811] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:41:18.547960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:18.548781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:18.555558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:18.556039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:18.556475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:18.557154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:18.557605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:18.558026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:18.589803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:18.589803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:18.590140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:18.590582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'fault' on Instance uuid 38c0cc71-00b5-4788-b7a4-844b9654da72 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:41:18.635378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:18.643231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b3ddd4a8-08ff-456c-95d7-f88534fcbded tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 200 len: 1309 microversion: 2.1 time: 0.099518 Sep 05 14:41:18.643767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 397/812] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:18 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 1309 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:19.127450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:19.128062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:19.130693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=60 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:19.135522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:19.136082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:19.136518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:19.137238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:19.137693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:19.138115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:19.156342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:19.280407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:19.289002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c450aa8a-1891-4ced-96cb-71f9967802fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.165585 Sep 05 14:41:19.289563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 416/813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:19.667795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:19.668318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 38c0cc71-00b5-4788-b7a4-844b9654da72] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:19.674622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:19.675129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:19.675557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:19.676236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:19.676747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:19.677183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:19.690915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] HTTP exception thrown: Instance 38c0cc71-00b5-4788-b7a4-844b9654da72 could not be found. Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Request method failure captured: Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 HTTP/1.1 Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgozZPsKHxjOPwqtslNwY4Jd9oO5ciA_fZdBAQamDv20DYiWTAQ8MN84GP19-lIyUZDoxK25oPdAFVoZV1pp7eghy87ovpQoIfx1RqjPkpTkLw25avii7mAFmTFr-_LYW8T8S3RnRZsbTkViRWGrDgRy-CwKV0hQTeXOmhPlehrOHFQ Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:41:19.692513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f60d54b7dc874a8080159b81aafc89d5"}]}] Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: dac33ec33c26411d9dcf8c3bbea7a9e9 Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 38c0cc71-00b5-4788-b7a4-844b9654da72 could not be found. Sep 05 14:41:19.694133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '38c0cc71-00b5-4788-b7a4-844b9654da72'} Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38c0cc71-00b5-4788-b7a4-844b9654da72 could not be found. Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:41:19.698455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38c0cc71-00b5-4788-b7a4-844b9654da72 could not be found. Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38c0cc71-00b5-4788-b7a4-844b9654da72 could not be found. Sep 05 14:41:19.700052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:41:19.701417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Returning 404 to user: Instance 38c0cc71-00b5-4788-b7a4-844b9654da72 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:41:19.701417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6f9113f3-7497-4968-b75d-3bfb118584c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72" status: 404 len: 111 microversion: 2.1 time: 0.030033 Sep 05 14:41:19.701417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 398/814] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:19 2022] GET /compute/v2.1/servers/38c0cc71-00b5-4788-b7a4-844b9654da72 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:41:20.311454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:20.312066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:20.320034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:20.320524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:20.321065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:20.321766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:20.322216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:20.322703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:20.474257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:20.482821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fae7af16-9464-4667-b90c-32bfa07c6b28 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.175187 Sep 05 14:41:20.483390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 417/815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:21.506439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:21.507093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:21.513492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:21.515032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:21.515032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:21.515232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:21.515515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:21.515936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:21.655816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:21.659331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:21.664875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f475dce6-7ece-4b25-84e8-fb6b84729a10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.162261 Sep 05 14:41:21.665439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 399/816] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:22.687711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:22.688438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:22.694806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:22.695345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:22.695821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:22.696500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:22.696950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:22.697367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:22.841213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:22.849657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ac325a9-9cb8-42bb-a448-fdff57953a75 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.165842 Sep 05 14:41:22.854699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 418/817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:23.873393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:23.874045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:23.880689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:23.881166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:23.882235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:23.882953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:23.883402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:23.896189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:24.025352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:24.033426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d33f83f2-2e8a-445a-a45d-94e8f2e33a31 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.164283 Sep 05 14:41:24.039430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 400/818] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:41:25.056851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:25.057455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:25.063910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:25.064388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:25.064814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:25.065496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:25.065998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:25.066362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:25.216589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:25.224912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-02384624-a442-4a77-9ad4-158e07639859 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1756 microversion: 2.1 time: 0.172062 Sep 05 14:41:25.225479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 419/819] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:26.248813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:26.249414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:26.251944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:26.258231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:26.258706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:26.259216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:26.259899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:26.260342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:26.260757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:26.405467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:26.414171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-91eb1a3f-4f87-4b19-8adb-c7121048665b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1759 microversion: 2.1 time: 0.170007 Sep 05 14:41:26.416782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 401/820] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1759 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:32.483743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1248931902", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "networks": [{"uuid": "66a2245b-c726-4c55-9119-b3dc61cb9c80"}]}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:32.540927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] validate_networks() for [('66a2245b-c726-4c55-9119-b3dc61cb9c80', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:41:33.115571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:41:33.115992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:41:33.117101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:41:33.117510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:41:33.117920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:41:33.126687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:33.127192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:33.127627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:33.128337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:33.128786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:33.129206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:33.145420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Getting quotas for project f60d54b7dc874a8080159b81aafc89d5. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:41:33.149266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Getting quotas for user dac33ec33c26411d9dcf8c3bbea7a9e9 and project f60d54b7dc874a8080159b81aafc89d5. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:41:33.159938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:41:33.162161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:41:33.336819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7530a61-7435-4ea1-8ba5-9a90610a5a60 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.857060 Sep 05 14:41:33.337461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 420/821] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:41:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 858 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 14:41:33.348864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53b177c3-1556-4c7d-8ba4-0f53eddb3931 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:33.349502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53b177c3-1556-4c7d-8ba4-0f53eddb3931 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:33.403047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53b177c3-1556-4c7d-8ba4-0f53eddb3931 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:33.410119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53b177c3-1556-4c7d-8ba4-0f53eddb3931 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1219 microversion: 2.1 time: 0.065318 Sep 05 14:41:33.415997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 402/822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:33 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:34.433616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:34.434223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:34.440583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:34.441065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:34.441497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:34.442207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:34.442657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:34.443118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:34.510224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:34.517960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-00ae9c5b-01e1-4ea2-a49c-f22e89b0e605 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1223 microversion: 2.1 time: 0.088731 Sep 05 14:41:34.518521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 421/823] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:34 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1223 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:35.541066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:35.541676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:35.548619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:35.549127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:35.549557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:35.550247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:35.550695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:35.551143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:35.613501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:35.621645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-531d18bb-539b-40bc-8999-6636347cc999 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1271 microversion: 2.1 time: 0.084883 Sep 05 14:41:35.622199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 403/824] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1271 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:36.644404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:36.644964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:36.651920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:36.652402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:36.652838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:36.653531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:36.653985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:36.654399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:36.727469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:36.736798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d18fc6a4-a821-4c20-9c8f-b602f4d73684 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1279 microversion: 2.1 time: 0.096346 Sep 05 14:41:36.737658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 422/825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1279 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:37.764038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:37.764423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:37.771807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:37.772408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:37.772952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:37.774367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:37.774849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:37.775335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:38.001009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:38.009474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22f4c82b-9f50-4e55-a75e-e60a53754072 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.250237 Sep 05 14:41:38.010070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 404/826] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:37 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:38.259872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-b3a5cf53-f434-4b79-b4fa-20a26afaf4d1 req-6b3fada1-d92d-480b-bd78-4ffbbf24ac1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04bf5a93-4e3a-4291-afcd-c0213a44d540", "tag": "f9048ed4-216e-453c-8839-d8d95b554ffe"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:38.270874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-b3a5cf53-f434-4b79-b4fa-20a26afaf4d1 req-6b3fada1-d92d-480b-bd78-4ffbbf24ac1d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:38.271419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-b3a5cf53-f434-4b79-b4fa-20a26afaf4d1 req-6b3fada1-d92d-480b-bd78-4ffbbf24ac1d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:38.271938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-b3a5cf53-f434-4b79-b4fa-20a26afaf4d1 req-6b3fada1-d92d-480b-bd78-4ffbbf24ac1d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:38.283903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-b3a5cf53-f434-4b79-b4fa-20a26afaf4d1 req-6b3fada1-d92d-480b-bd78-4ffbbf24ac1d service nova] Creating event network-changed:f9048ed4-216e-453c-8839-d8d95b554ffe for instance 04bf5a93-4e3a-4291-afcd-c0213a44d540 on hv-cinder-84290 Sep 05 14:41:38.290368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-b3a5cf53-f434-4b79-b4fa-20a26afaf4d1 req-6b3fada1-d92d-480b-bd78-4ffbbf24ac1d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033750 Sep 05 14:41:38.291061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 423/827] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:41:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:41:39.032874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:39.033487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:39.040406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:39.040889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:39.041320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:39.041996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:39.042459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:39.042894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:39.171416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:39.179236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b8796d5b-4f45-41ef-8d9c-5d62d7404707 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.150596 Sep 05 14:41:39.180091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 405/828] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:39 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:40.202439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:40.203260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:40.209341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:40.209819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:40.210248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:40.210961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:40.211918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:40.212337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:40.339573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:40.347397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-669948a4-ffe2-4250-8211-957888510d1f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.149508 Sep 05 14:41:40.347955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 424/829] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:41.370859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:41.371518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:41.377898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:41.378378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:41.378831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:41.379518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:41.379966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:41.380387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:41.515023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:41.522649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-904085bf-f074-42b0-bdff-7201b4f2a8ed tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.156351 Sep 05 14:41:41.523238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 406/830] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:41 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:42.545500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:42.546102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:42.552644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:42.553117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:42.553544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:42.554246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:42.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:42.555625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:42.686777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:42.694397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-23999c04-5a95-41e0-897d-d47a09d597d8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.152978 Sep 05 14:41:42.694990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 425/831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:42 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:43.717472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:43.718083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:43.720115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:43.725096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:43.725572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:43.725996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:43.727334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:43.727786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:43.728200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:43.860197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:43.868317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8ec168fc-f942-4e4e-8713-1579bfb70281 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.154234 Sep 05 14:41:43.868879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 407/832] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:43 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:44.892076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:44.892664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:44.894885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:44.895579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=6 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:44.901974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:44.902576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:44.903211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:44.904030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:44.904546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:44.905072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:45.036490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:45.044884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f51f684-57bb-4d72-9e01-60f45e43d6e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.157675 Sep 05 14:41:45.045449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 426/833] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:44 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:46.069856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:46.070487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:46.077091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:46.077571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:46.078005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:46.078695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:46.079172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:46.079594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:46.214949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:46.223087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-08e477ea-e0cf-4489-ab60-a79e45ff6892 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.157023 Sep 05 14:41:46.223711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 408/834] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:46.979399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-cffd9f6f-17f2-4320-8465-f02188f11745 req-9885792c-396c-4f7d-b2ee-6476d186c932 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf5a93-4e3a-4291-afcd-c0213a44d540", "name": "network-vif-plugged", "status": "completed", "tag": "f9048ed4-216e-453c-8839-d8d95b554ffe"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:46.989518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-cffd9f6f-17f2-4320-8465-f02188f11745 req-9885792c-396c-4f7d-b2ee-6476d186c932 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:46.990001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-cffd9f6f-17f2-4320-8465-f02188f11745 req-9885792c-396c-4f7d-b2ee-6476d186c932 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:46.990430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-cffd9f6f-17f2-4320-8465-f02188f11745 req-9885792c-396c-4f7d-b2ee-6476d186c932 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:47.001523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-cffd9f6f-17f2-4320-8465-f02188f11745 req-9885792c-396c-4f7d-b2ee-6476d186c932 service nova] Creating event network-vif-plugged:f9048ed4-216e-453c-8839-d8d95b554ffe for instance 04bf5a93-4e3a-4291-afcd-c0213a44d540 on hv-cinder-84290 Sep 05 14:41:47.006713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-cffd9f6f-17f2-4320-8465-f02188f11745 req-9885792c-396c-4f7d-b2ee-6476d186c932 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031755 Sep 05 14:41:47.007344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 427/835] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:41:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:41:47.245941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:47.246533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:47.253284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:47.253765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:47.254198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:47.254909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:47.255361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:47.261528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:47.385004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:47.392581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6bebcc0a-3439-43a6-9ef8-e5d3e059932a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.151062 Sep 05 14:41:47.393139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 409/836] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:47 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:48.416670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:48.417280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:48.423975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:48.424450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:48.424880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:48.425563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:48.426041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:48.426461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:48.559975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:48.568375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ac499c85-d931-4c78-8a3e-e0c08d4c4720 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.156741 Sep 05 14:41:48.569043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 428/837] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:48 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:49.591693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:49.592292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:49.599139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:49.599623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:49.600084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:49.600772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:49.601224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:49.602139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:49.740630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:49.748976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ea4c60cf-7a62-4fb3-b2f2-cafca8e7003e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1319 microversion: 2.1 time: 0.161184 Sep 05 14:41:49.749537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 410/838] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:50.771315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:41:50.771920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:50.774290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:50.778947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:50.779425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:50.779854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:50.780580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:50.781024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:50.781441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:50.786045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=63 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:41:50.915387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:41:50.922899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-899a567f-fc02-4620-8c6f-59185523c61a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1508 microversion: 2.1 time: 0.155391 Sep 05 14:41:50.923461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 429/839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:41:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1508 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:41:50.945089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a205cfe-8bed-498b-8df7-dca3d677be34", "device": "/dev/sdb"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:41:50.948075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:41:50.954383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:50.954899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:50.955335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:50.956016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:41:50.956467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:41:50.956888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:41:51.831268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3df70024-d020-4e5d-871b-dca7e68dc312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "POST /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.889912 Sep 05 14:41:51.831818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 411/840] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 14:41:50 2022] POST /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments => generated 194 bytes in 891 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:42:07.050352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:07.050930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:07.053438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:07.054110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=5 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:07.059355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:07.059837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:07.060269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:07.060954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:07.061406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:07.061826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:07.091871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-77f7453b-c8d2-4e49-b6df-3e68e4a7c13c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments/2192c5bd-ccf7-4161-9e80-1e5c4ea0808f" status: 200 len: 194 microversion: 2.20 time: 0.045418 Sep 05 14:42:07.092446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 430/841] 10.222.0.15 () {60 vars in 1454 bytes} [Mon Sep 5 14:42:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments/2192c5bd-ccf7-4161-9e80-1e5c4ea0808f => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:07.157793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=23 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:07.158654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:07.162902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:07.163494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:07.170065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:07.170618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:07.171092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:07.171774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:07.172221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:07.172642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:07.256387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lazy-loading 'services' on Instance uuid 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:42:07.489387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6cdbf2e0-2126-471e-89e8-0a9a30415580 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments/2192c5bd-ccf7-4161-9e80-1e5c4ea0808f" status: 202 len: 0 microversion: 2.20 time: 0.332835 Sep 05 14:42:07.489937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 412/842] 10.222.0.15 () {60 vars in 1457 bytes} [Mon Sep 5 14:42:07 2022] DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments/2192c5bd-ccf7-4161-9e80-1e5c4ea0808f => generated 0 bytes in 334 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:42:07.499593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:07.501844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:07.508132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:07.508617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:07.509051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:07.509737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:07.510193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:07.510829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:07.539635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0dc23a5d-00cb-47cd-8631-b1571b291d0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045285 Sep 05 14:42:07.540186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 431/843] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:08.412057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:08.412657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:08.419365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:08.419840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:08.420269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:08.420944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:08.421391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:08.421834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:08.501142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'services' on Instance uuid 6dc3d4fd-7509-404c-af29-824137cd6af4 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:42:08.552782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:08.554921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:08.561172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:08.567992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:08.567992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:08.567992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:08.567992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:08.568384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:08.593607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-da8c27e4-8507-4aa0-a49b-2aaf30a38222 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044701 Sep 05 14:42:08.594157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 432/844] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:42:08.824785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8e19071f-004c-4a0e-986d-789f43a9d033 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments/41291c5c-98b5-40a9-bf43-3fd81fcb369e" status: 202 len: 0 microversion: 2.1 time: 0.417034 Sep 05 14:42:08.825578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 413/845] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:42:08 2022] DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments/41291c5c-98b5-40a9-bf43-3fd81fcb369e => generated 0 bytes in 419 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:42:08.833827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:08.835996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:08.841855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:08.842382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:08.842839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:08.843621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:08.844078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:08.844499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:08.873570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f05fe1ee-8d63-46a8-91f4-ebf78a297d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043688 Sep 05 14:42:08.877521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 433/846] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:09.607566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:09.609872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:09.616079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:09.616557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:09.616985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:09.617665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:09.618112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:09.618530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:09.647709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-60400c87-ad21-4756-8832-d2caed54fc1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045021 Sep 05 14:42:09.648244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 414/847] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:09.888337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:09.890381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:09.896960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:09.897435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:09.897864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:09.898538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:09.899055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:09.899475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:09.927710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-77c61c6a-4984-4a64-9c53-1a13933fbdf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043458 Sep 05 14:42:09.928243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 434/848] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:10.661267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:10.663496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:10.670280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:10.670751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:10.671219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:10.671900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:10.672343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:10.672761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:10.702146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b79f8ceb-f4e3-44e0-962b-66623c817b7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044811 Sep 05 14:42:10.702704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 415/849] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:10.940255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:10.942345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:10.948692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:10.949171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:10.949602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:10.950284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:10.950732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:10.951176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:10.980801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-41c1f380-11d3-4a88-88a2-7f3cdbb33933 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044630 Sep 05 14:42:10.981351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 435/850] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:11.714970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:11.717088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:11.723735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:11.724216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:11.724648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:11.725360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:11.725809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:11.726230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:11.755055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7137c12b-8ca9-462d-8964-91db6fb576b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044127 Sep 05 14:42:11.755603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 416/851] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:11.993891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:11.996664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:12.002930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:12.003410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:12.003842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:12.004523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:12.004971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:12.005389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:12.034019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d1ee1c23-d4ef-4962-abe9-422ab378667a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044025 Sep 05 14:42:12.034555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 436/852] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:12.767686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:12.769739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:12.776691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:12.777164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:12.777592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:12.778262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:12.778705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:12.779152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:12.807018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22583de3-fb3d-4fe5-b77d-d1440009a335 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043331 Sep 05 14:42:12.807557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 417/853] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:13.045795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:13.047916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:13.054250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:13.062927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:13.062927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:13.062927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:13.062927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:13.063350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:13.086373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-21396309-9a18-4b92-bdd3-0ce7850f1426 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044568 Sep 05 14:42:13.086957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 437/854] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:13.818661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:13.820824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:13.827190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:13.827692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:13.828124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:13.828807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:13.829262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:13.829690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:13.859374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b9e9321f-47a5-4ca4-803e-16ac758b8bb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044697 Sep 05 14:42:13.859918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 418/855] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:14.099773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:14.101918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:14.109106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:14.126384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:14.126384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:14.126384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:14.126384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:14.126819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:14.139950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7e166564-a1d8-437e-b16d-bcc914bfa063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044514 Sep 05 14:42:14.140496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 438/856] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:14.872067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:14.874196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:14.880485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:14.880953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:14.881376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:14.882047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:14.882490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:14.882931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:14.911376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7e250396-9c94-46f2-9ff7-51153e7218e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043378 Sep 05 14:42:14.911914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 419/857] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:42:15.153306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:15.155396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:15.161707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:15.162188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:15.162620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:15.163335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:15.163881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:15.164304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:15.192539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-71c0751d-1c1c-4018-afe5-ff8fc68a2236 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044009 Sep 05 14:42:15.193079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 439/858] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:15.924093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:15.926324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:15.933291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:15.933781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:15.934203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:15.934904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:15.935351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:15.935766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:15.964269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-97941a04-9fb4-49dc-aade-89314a730e0e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044215 Sep 05 14:42:15.964813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 420/859] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:16.205143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:16.207460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:16.213834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:16.214317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:16.214773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:16.215475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:16.215925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:16.216344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:16.245826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0f60eaee-85ee-44cf-a496-20bff0c2e688 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Sep 05 14:42:16.246370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 440/860] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:42:16.978329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:16.980526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:16.986899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:16.987383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:16.987818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:16.988506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:16.988960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:16.989384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:17.019521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4781c96e-65f4-40d0-92e7-ced4f523fe02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045230 Sep 05 14:42:17.020092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 421/861] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:17.258257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:17.260368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:17.266938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:17.267417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:17.267850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:17.268533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:17.268987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:17.269409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:17.299195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b002d7f5-daa0-46f5-a3e5-0fd72f3e5a0c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Sep 05 14:42:17.299749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 441/862] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:18.032888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:18.034986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:18.041413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:18.041891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:18.042324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:18.043027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:18.043473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:18.043911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:18.072758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-611fde0e-a876-4eca-9e3f-138a6b8e2a11 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043431 Sep 05 14:42:18.073306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 422/863] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:18.311732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:18.314032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:18.320355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:18.321581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:18.321581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:18.322052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:18.323056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:18.323476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:18.352923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a1604bbc-b334-464f-8947-0fad1edbda96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045222 Sep 05 14:42:18.353461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 442/864] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:19.085416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:19.087530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:19.094258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:19.094740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:19.095183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:19.095879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:19.096328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:19.096747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:19.126123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fdeb4e12-923a-4a7e-b747-7380a9f2f6f1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044764 Sep 05 14:42:19.126671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 423/865] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:19.365300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:19.367379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:19.373670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:19.374141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:19.374568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:19.375268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:19.375716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:19.376132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:19.404874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1233f61d-8e07-40f5-aa82-111a26e77dfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043606 Sep 05 14:42:19.405435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 443/866] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:20.138949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:20.141038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:20.147472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:20.147949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:20.148377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:20.149054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:20.149496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:20.149910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:20.179114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-31acb20a-f87d-4c86-92df-bb01e45ba945 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044239 Sep 05 14:42:20.179649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 424/867] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:20.417298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:20.419380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:20.425731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:20.426209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:20.426642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:20.427363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:20.427814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:20.428234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:20.456850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a008d4a-2047-4902-a4b6-ebea0fad71fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043664 Sep 05 14:42:20.457389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 444/868] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:21.191792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:21.193928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:21.200320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:21.200800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:21.201229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:21.201907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:21.202359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:21.202782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:21.232392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5105c643-2f35-4add-8418-11dd7ca1aa8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044707 Sep 05 14:42:21.232949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 425/869] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:21.469103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:21.471330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:21.477882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:21.478361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:21.478810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:21.479498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:21.479977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:21.480396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:21.509118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-24ad2d87-91fe-48fa-b13d-2355df675efc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Sep 05 14:42:21.509656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 445/870] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:42:22.245136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:22.247253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:22.253586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:22.254058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:22.254490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:22.255257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:22.255705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:22.256118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:22.284603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0e3d738e-ce72-4685-865a-9544ce7d8067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043555 Sep 05 14:42:22.285135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 426/871] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:22.521636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:22.523811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:22.530802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:22.531284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:22.531711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:22.532384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:22.532830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:22.533243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:22.549411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:22.562064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ca423cd-9186-4254-ade3-b72d9e586608 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Sep 05 14:42:22.563635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 446/872] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:23.297675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:23.299846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:23.306140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:23.307226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:23.307665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:23.308344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:23.308789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:23.309204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:23.314137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:23.338981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6be04110-30fc-4a20-b6ef-1eb4c8d02348 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045228 Sep 05 14:42:23.339530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 427/873] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:23.574517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:23.576580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:23.583248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:23.583722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:23.584151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:23.584824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:23.585268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:23.585682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:23.614497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-813f5323-da94-482f-b7b3-d36ad5e327da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044576 Sep 05 14:42:23.615062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 447/874] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:24.352196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:24.354931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:24.361967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:24.362469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:24.362914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:24.363609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:24.364056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:24.364500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:24.393133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2eef6e97-db64-44ed-89cc-c4cb6a48b117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044967 Sep 05 14:42:24.393712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 428/875] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:24.626839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:24.628919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:24.635282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:24.635760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:24.636184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:24.636862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:24.637325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:24.637744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:24.666994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-97608baa-480b-4d91-897c-167b2af5ed15 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043480 Sep 05 14:42:24.667533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 448/876] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:25.406479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:25.408683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:25.415441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:25.415918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:25.416988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:25.417675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:25.418124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:25.418569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:25.446736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d5ac608b-4548-4134-9c57-a23b47098c4e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044294 Sep 05 14:42:25.447307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 429/877] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:25.679373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:25.681612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:25.687941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:25.688416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:25.688844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:25.689519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:25.689990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:25.690406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:25.719586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d39da744-c486-405f-b91f-1daa33a44036 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044284 Sep 05 14:42:25.720128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 449/878] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:26.459308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:26.461412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:26.467710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:26.468179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:26.468603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:26.469273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:26.469716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:26.470132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:26.499353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-543686a1-00ee-4f80-86cd-57413483eff9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044151 Sep 05 14:42:26.499898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 430/879] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:26.732796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:26.735033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:26.741640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:26.742173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:26.742693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:26.743599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:26.744146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:26.744628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:26.773177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-454be28b-d6ce-4a13-9d8c-d666036df22a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045053 Sep 05 14:42:26.773795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 450/880] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:27.512603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:27.514729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:27.521086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:27.521566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:27.522000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:27.522680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:27.523157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:27.523578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:27.551765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a0a90ebf-fbb8-48ad-9de3-45df70f5bf3e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043772 Sep 05 14:42:27.552306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 431/881] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:27.785709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:27.787802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:27.794394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:27.794911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:27.795343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:27.796022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:27.796472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:27.796892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:27.825540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f3c47b67-fe35-427a-aa86-67676ef243d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Sep 05 14:42:27.826653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 451/882] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:28.565256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:28.567427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:28.573832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:28.574303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:28.574730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:28.575428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:28.575871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:28.576285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:28.604544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1d10a74c-cfe0-49d5-a1fc-5d71a79be9a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043302 Sep 05 14:42:28.605597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 432/883] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:28.837143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:28.839809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:28.846152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:28.846637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:28.847385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:28.848078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:28.848535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:28.848960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:28.878272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1b92c0f0-d82a-40c4-90bc-9581f98513a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045121 Sep 05 14:42:28.878844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 452/884] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:29.617631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:29.619780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:29.626617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:29.627126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:29.627561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:29.628242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:29.628700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:29.629120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:29.658115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6916bf8f-800c-45ac-b253-345ff611deb6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044539 Sep 05 14:42:29.658648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 433/885] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:29.891332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:29.893424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:29.899720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:29.900200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:29.900634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:29.901315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:29.902282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:29.902706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:29.932267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3df44842-7234-4799-a670-110320629911 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045031 Sep 05 14:42:29.932812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 453/886] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:30.671320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:30.673428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:30.680081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:30.680557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:30.680986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:30.681700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:30.682152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:30.682562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:30.711382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53789616-5c64-4336-b798-8bd145e5afbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044683 Sep 05 14:42:30.711927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 434/887] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:30.944032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:30.946090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:30.952419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:30.952899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:30.953332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:30.954019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:30.954470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:30.954921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:30.983847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aa52526d-7344-47be-925d-16829a827fd3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043862 Sep 05 14:42:30.984395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 454/888] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:31.725330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:31.727500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:31.733940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:31.734419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:31.734875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:31.735565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:31.736017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:31.736442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:31.765326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1240c5c1-8e20-4d88-8a00-0037a0d8ff85 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045237 Sep 05 14:42:31.765881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 435/889] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:31.997066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:31.999249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:32.006097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:32.006602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:32.007067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:32.007755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:32.008210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:32.008628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:32.038206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-338ef4b6-bd15-45dc-a91c-fd69fa2e6600 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Sep 05 14:42:32.038759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 455/890] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:32.778192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:32.780325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:32.786741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:32.787253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:32.787704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:32.788366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:32.788818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:32.789240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:32.818273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6d562cb9-95ca-4f1b-b5bc-9e944f274af3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044579 Sep 05 14:42:32.818762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 436/891] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:33.050636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:33.052776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:33.059144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:33.059598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:33.060027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:33.060711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:33.061161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:33.061579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:33.091515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9718dc4f-0a21-49ea-9c7a-e3eb6e96244b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044848 Sep 05 14:42:33.091987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 456/892] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:33.830553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:33.832716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:33.839119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:33.839592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:33.840019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:33.840693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:33.841136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:33.841551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:33.871073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dae80cf0-fd02-4733-a0eb-8f392d85fae3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044688 Sep 05 14:42:33.871621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 437/893] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:34.103714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:34.105908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:34.112970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:34.113473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:34.113900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:34.114603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:34.115081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:34.115506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:34.144061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c765b05d-40ed-4e3a-b5ee-ccdb34c96dee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044328 Sep 05 14:42:34.144601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 457/894] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:34.884181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:34.886298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:34.893242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:34.893722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:34.894151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:34.894857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:34.895309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:34.895725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:34.923987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1dcb7c15-bbaa-4dd5-a243-436bf403277c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043849 Sep 05 14:42:34.924526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 438/895] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:35.156544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:35.158566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:35.164953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:35.165429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:35.165861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:35.166538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:35.167024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:35.167443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:35.196945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b02e5b03-e609-43d9-beea-2d61ef69d165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044471 Sep 05 14:42:35.197530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 458/896] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:35.936360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:35.938576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:35.945048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:35.945531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:35.945968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:35.946662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:35.947150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:35.947575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:35.977885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24c88f7b-f372-4bcb-87ca-d306b3c9c3a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046075 Sep 05 14:42:35.978481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 439/897] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:36.209108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:36.211247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:36.218173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:36.218664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:36.219138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:36.219827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:36.220287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:36.220711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:36.250216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a4cf5f5-0053-47d9-87e6-011097ee058c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045164 Sep 05 14:42:36.250779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 459/898] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:36.990753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:36.992895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:36.999399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:37.000401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:37.000839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:37.001524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:37.001973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:37.002390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:37.031656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6451008f-9124-4ad9-b239-8b4f2ef4ab68 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044848 Sep 05 14:42:37.032199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 440/899] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:37.262581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:37.264771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:37.271800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:37.272284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:37.272712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:37.273402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:37.273848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:37.274280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:37.303066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b014bf9-a4ac-4584-9b67-376ee609da47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044481 Sep 05 14:42:37.303614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 460/900] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:38.044231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:38.046384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:38.049295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=59 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:38.053900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:38.054464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:38.054932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:38.055628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:38.056080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:38.056507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:38.085910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-74b2510a-480e-4a82-abf1-a53826c52384 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045710 Sep 05 14:42:38.086505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 441/901] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:38.314446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:38.316629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:38.319226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=63 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:38.323929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:38.324410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:38.324906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:38.325595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:38.326136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:38.326562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:38.357044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6e350fa1-9e0b-4c2f-85e1-2ceacc73e40d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046596 Sep 05 14:42:38.357604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 461/902] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:39.098545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:39.100730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:39.107520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:39.108055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:39.108485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:39.109709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:39.110164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:39.110582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:39.139531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-05683c2b-583a-4f09-9370-7607a9c1e8c0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045272 Sep 05 14:42:39.140074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 442/903] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:39.369419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:39.371590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:39.378295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:39.378770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:39.382057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:39.382057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:39.382057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:39.382057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:39.409317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e810ccc-d34d-4485-a524-ffb489f4dd7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Sep 05 14:42:39.409859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 462/904] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:40.152086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:40.154266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:40.160618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:40.161097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:40.161530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:40.162214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:40.162664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:40.163111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:40.187097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:40.192133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ec39d23c-a948-4ea4-8c80-3c60bcbddfd9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044064 Sep 05 14:42:40.192666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 443/905] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:40.421392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:40.424194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:40.430317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:40.430806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:40.431252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:40.431932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:40.432383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:40.432802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:40.436428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:40.461920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0b90bed3-59bc-413d-b191-70a605ccade7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044439 Sep 05 14:42:40.462465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 463/906] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:41.205184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:41.207302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:41.213910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:41.214387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:41.214832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:41.215510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:41.215954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:41.216372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:41.245546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a7684939-f874-4efe-9314-e59b0af917a8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044848 Sep 05 14:42:41.246078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 444/907] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:41.474635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:41.476799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:41.483589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:41.484068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:41.484498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:41.485176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:41.485629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:41.486050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:41.515356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4b97df3d-3631-4a1a-a15f-09922ea0e3df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045087 Sep 05 14:42:41.515905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 464/908] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:42.258048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:42.260174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:42.266481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:42.266990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:42.267419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:42.268093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:42.268539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:42.269001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:42.297697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae6832c2-84b2-44b6-a399-bb25872a2234 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043661 Sep 05 14:42:42.298238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 445/909] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:42.528218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:42.530338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:42.537210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:42.537699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:42.538136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:42.538866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:42.539323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:42.539747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:42.568495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8ff20e25-670d-4e65-a801-10fa96d647e3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Sep 05 14:42:42.569050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 465/910] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:43.310962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:43.313111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:43.320129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:43.320609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:43.321043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:43.321731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:43.322181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:43.322604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:43.351209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e5d09dd8-eee7-4867-af16-090cc4dab262 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044221 Sep 05 14:42:43.351697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 446/911] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:43.580329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:43.582515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:43.584524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:42:43.584667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:42:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments (ip 10.222.0.15) !!! Sep 05 14:42:43.594822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:43.595310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:43.595752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:43.596477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:43.599651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:43.600098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:43.637148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-385a01f7-b477-4be3-bb58-0c61943f003a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060742 Sep 05 14:42:43.637627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 466/912] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:44.363654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:44.365831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:44.372045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:44.372533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:44.372966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:44.373652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:44.374162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:44.374643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:44.404784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cd6b01be-bf2f-4b08-9bf2-3f962f3be895 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045295 Sep 05 14:42:44.405327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 447/913] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:44.650192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:44.652294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:44.659091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:44.659599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:44.660056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:44.660740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:44.661255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:44.661685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:44.692756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-25f16539-7b98-464c-a1a5-58e58fc553b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Sep 05 14:42:44.693327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 467/914] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:45.417646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:45.419714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:45.426152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:45.426634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:45.427101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:45.427786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:45.428234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:45.428653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:45.457133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-52faf844-9768-4ece-b043-3d32486100a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043688 Sep 05 14:42:45.457668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 448/915] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:45.705308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:45.708046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:45.714507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:45.715025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:45.715466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:45.716153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:45.716643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:45.717062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:45.745940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-514fb463-ac49-41b1-8aa7-5765e1ef91e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044689 Sep 05 14:42:45.746486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 468/916] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:46.066312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2087962235"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:42:46.066855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:46.072816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.073298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.076574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.076574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.076574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.076574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.205636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.network.security_group_api [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Removing security group de9f8c0f-1106-4dae-8e94-6008c8aa4483 from port 9de7df6c-259e-4f36-ab19-ce48818db64b Sep 05 14:42:46.470208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:46.473134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:46.478987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.488545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.488545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.488545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.488545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.488936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.510746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-54e1c075-dbd2-48c6-917f-59109f919382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044762 Sep 05 14:42:46.513525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 469/917] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:42:46.592959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6364ae8a-1a55-4783-8f93-13550b98f045 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action" status: 202 len: 0 microversion: 2.1 time: 0.531338 Sep 05 14:42:46.597531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 449/918] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:42:46 2022] POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action => generated 0 bytes in 533 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:42:46.608403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-2a99e138-20ea-4a19-8370-a1516ab761f1 req-d47115b8-a5d8-434f-a438-526a347247e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:42:46.618533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2a99e138-20ea-4a19-8370-a1516ab761f1 req-d47115b8-a5d8-434f-a438-526a347247e3 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.618694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2a99e138-20ea-4a19-8370-a1516ab761f1 req-d47115b8-a5d8-434f-a438-526a347247e3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.619044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2a99e138-20ea-4a19-8370-a1516ab761f1 req-d47115b8-a5d8-434f-a438-526a347247e3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.633865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-2a99e138-20ea-4a19-8370-a1516ab761f1 req-d47115b8-a5d8-434f-a438-526a347247e3 service nova] Creating event network-changed:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 14:42:46.637667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-2a99e138-20ea-4a19-8370-a1516ab761f1 req-d47115b8-a5d8-434f-a438-526a347247e3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033520 Sep 05 14:42:46.638559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 470/919] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:42:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:46.758853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:46.760976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:46.766940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.767554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.767988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.769202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:46.769690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:46.770095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:46.803338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d1889c03-c2ce-4390-a4e6-6199b2feaa3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048411 Sep 05 14:42:46.803883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 450/920] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:47.524762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:47.527070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:47.533108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:47.533582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:47.534012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:47.534694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:47.535161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:47.535572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:47.567077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d06f371-6a5c-4514-83a9-6ff8bee22ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047140 Sep 05 14:42:47.567635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 471/921] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:47.760618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:47.761142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:47.767450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:47.767925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:47.768409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:47.769105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:47.769558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:47.769983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:47.816038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:47.818507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:47.824325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:47.824808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:47.825237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:47.826056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:47.826541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:47.826996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:47.856222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lazy-loading 'services' on Instance uuid a50e765d-9688-493d-ac8c-fd4bf3bb5580 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:42:47.857466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c190e51f-a77f-4beb-b021-6fcf75732c47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045530 Sep 05 14:42:47.858023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 472/922] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:42:48.105426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aa5e37e6-3b6a-42b8-8c3e-48c3d911e9ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments/81152632-7f7d-4c39-9601-23b15857f1b1" status: 202 len: 0 microversion: 2.1 time: 0.348498 Sep 05 14:42:48.106022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 451/923] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:42:47 2022] DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments/81152632-7f7d-4c39-9601-23b15857f1b1 => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:42:48.115360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:48.117550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:48.123800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.124292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.124729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.125441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.125894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.126655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.157552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-99ddab8a-1fa6-4043-a37d-b65e60df29c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046899 Sep 05 14:42:48.158130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 473/924] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:48.582070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:48.584450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:48.591874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.592433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.592942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.593648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.594338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.594874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.626628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f42df6a9-4b24-45f0-ac22-23255008d806 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049459 Sep 05 14:42:48.627222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 452/925] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:48.653940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-dc1a94dd-3dc1-498b-99b7-3c57c7650501 req-60b994cc-7d20-4e85-918b-ecf7e79b9b91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:42:48.664044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-dc1a94dd-3dc1-498b-99b7-3c57c7650501 req-60b994cc-7d20-4e85-918b-ecf7e79b9b91 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.664543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-dc1a94dd-3dc1-498b-99b7-3c57c7650501 req-60b994cc-7d20-4e85-918b-ecf7e79b9b91 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.664957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-dc1a94dd-3dc1-498b-99b7-3c57c7650501 req-60b994cc-7d20-4e85-918b-ecf7e79b9b91 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.676457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-dc1a94dd-3dc1-498b-99b7-3c57c7650501 req-60b994cc-7d20-4e85-918b-ecf7e79b9b91 service nova] Creating event network-changed:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 14:42:48.681590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-dc1a94dd-3dc1-498b-99b7-3c57c7650501 req-60b994cc-7d20-4e85-918b-ecf7e79b9b91 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031298 Sep 05 14:42:48.685003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 474/926] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:42:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:48.869766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:48.871982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:48.878325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.878825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.879268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.879953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:48.880409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:48.880834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:48.909656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-89ea4d33-e292-4ac8-a125-4056824c1586 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043353 Sep 05 14:42:48.910206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 453/927] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:49.171855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:49.174058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:49.180195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:49.181157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:49.181594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:49.182277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:49.182728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:49.183174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:49.212227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c6927a5a-2cf9-45ad-bf11-bd7a63571d56 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044693 Sep 05 14:42:49.212772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 475/928] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:49.639680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:49.641798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:49.648717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:49.649190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:49.649618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:49.650294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:49.650739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:49.651307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:49.680452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-82e6559e-a4fd-473b-84f4-482f2926b50e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044650 Sep 05 14:42:49.681002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 454/929] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:49.922295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:49.924376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:49.931227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:49.931715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:49.932154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:49.932838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:49.933293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:49.933716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:49.963632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90df45d2-0fdf-4cb3-af22-e65c4749cf66 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045361 Sep 05 14:42:49.964249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 476/930] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:50.224328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:50.226533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:50.233113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:50.233696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:50.234157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:50.234863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:50.235318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:50.235740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:50.265388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3fea6c6-348a-41df-b96f-310acab179e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045528 Sep 05 14:42:50.265935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 455/931] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:50.693623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:50.695824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:50.701766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:50.702280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:50.702727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:50.703572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:50.704028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:50.704452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:50.733150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-93d52b01-e47a-44ef-84fb-cd525d0d8da2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044185 Sep 05 14:42:50.733693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 477/932] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:50.976234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:50.978380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:50.984251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:50.984729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:50.985163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:50.985844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:50.986292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:50.986711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:51.016045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c4d4601-43de-4ea0-9e7e-2377e890b269 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044509 Sep 05 14:42:51.016591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 456/933] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:51.278149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:51.280298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:51.287422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:51.287919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:51.288351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:51.289030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:51.289483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:51.289944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:51.318197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-32667a8b-cd56-4190-94f7-5f71dd5541c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Sep 05 14:42:51.318742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 478/934] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:51.745951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:51.748466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:51.755204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:51.755684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:51.756119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:51.756853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:51.757301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:51.757722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:51.787062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f6af9efa-fbaa-4a66-a28b-d16b67dfcffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045196 Sep 05 14:42:51.787606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 457/935] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:52.031667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:52.033841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:52.039762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:52.040236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:52.040666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:52.041342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:52.041854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:52.042277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:52.072061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a1d3996e-ecea-4ca9-b950-ecdfe7d6deb0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044278 Sep 05 14:42:52.072630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 479/936] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:52.330482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:52.332598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:52.338433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:52.338930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:52.339405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:52.340064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:52.340542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:52.340959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:52.369728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09c3c135-0dfe-4e82-a393-fa3ee7ff33d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043232 Sep 05 14:42:52.370270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 458/937] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:52.799687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:52.801874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:52.808307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:52.808784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:52.809213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:52.809892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:52.810345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:52.810763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:52.839506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9c902cb7-60e0-4c19-8a7c-760514e40574 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043922 Sep 05 14:42:52.840057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 480/938] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:53.085515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:53.087755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:53.094283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:53.094766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:53.095240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:53.095961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:53.096615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:53.096854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:53.126487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83d58b31-914d-4b92-bab3-cf60d3752e4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045748 Sep 05 14:42:53.127085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 459/939] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:53.382330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:53.384511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:53.390377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:53.390929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:53.391314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:53.391991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:53.392444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:53.392870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:53.397226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:53.421419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6bf124e-9523-4a94-b46d-49890c6dbe51 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Sep 05 14:42:53.421976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 481/940] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:53.852881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:53.855006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:53.861110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:53.861586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:53.862012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:53.862690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:53.863160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:53.864233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:53.868060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:42:53.893473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d35e21a2-8186-4b3e-9493-ba6f92e9d7bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044664 Sep 05 14:42:53.894170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 460/941] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:54.139557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:54.141766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:54.149233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:54.149713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:54.150172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:54.150894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:54.151382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:54.151815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:54.181092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b0fa3db1-d5b5-42a4-9825-47c963872bf6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045571 Sep 05 14:42:54.181645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 482/942] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:54.438704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:54.438704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:54.446294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:54.446814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:54.447266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:54.448006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:54.448507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:54.448982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:54.482147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a44333a1-3b0e-45c6-8b55-a1bb6f7179bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051558 Sep 05 14:42:54.482694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 461/943] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:54.906041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:54.908175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:54.914634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:54.915134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:54.915564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:54.916242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:54.916688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:54.917105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:54.945151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ba2317b-9a61-4a1a-b61d-e725a620ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043148 Sep 05 14:42:54.945686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 483/944] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:55.193429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:55.195746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:55.202527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.203079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.203540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.204226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.204684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.205107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.235238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b469c107-4644-4547-9f2f-43c71fc54d3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045935 Sep 05 14:42:55.235779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 462/945] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:55.494500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:55.496628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:55.502936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.503412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.503839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.505033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.505479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.505893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.534111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-74452f8e-6550-4ca5-832e-ce36f3d9cb93 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Sep 05 14:42:55.534646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 484/946] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:55.904107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:55.904630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:55.910959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.911432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.911878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.912532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.912978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.913399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.935949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c52f28c1-2abe-48ce-b9e3-d2f9f0b2a0c0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a/ips" status: 200 len: 148 microversion: 2.1 time: 0.035711 Sep 05 14:42:55.936717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 463/947] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:42:55 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a/ips => generated 148 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:55.957398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:55.959506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:55.965248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.965720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.966145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.966851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:55.967298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:55.967711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:55.997791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c8305e61-ebc0-40f8-8105-d81e47f0c27b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044281 Sep 05 14:42:55.998341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 485/948] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:56.246691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:56.248845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:56.254715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:56.255229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:56.255693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:56.256373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:56.256829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:56.257250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:56.285974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-787c5578-77be-42d1-aaf4-7ad0c9d62082 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Sep 05 14:42:56.286513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 464/949] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:56.546197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:56.548432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:56.554898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:56.555464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:56.555851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:56.556534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:56.557003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:56.557468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:56.586765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c407c454-0d56-4079-8c48-01086c5edf66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Sep 05 14:42:56.587382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 486/950] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:57.010451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:57.013319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:57.023538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.023538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.023538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.023538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.023986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.024814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.062773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-66089601-9bc1-4b50-afc2-ca9d1846b77c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055565 Sep 05 14:42:57.063955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 465/951] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:57.297663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:57.300661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:57.307581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.308395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.309015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.309910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.310540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.310995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.314921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:42:57.318254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:57.324688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.325476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.326149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.327751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.328443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.329076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.348723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cd3198fd-65fa-4cfe-83f9-88e361382f5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054926 Sep 05 14:42:57.351390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 487/952] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:57.355376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lazy-loading 'flavor' on Instance uuid 0921c73a-ed22-41a2-b38f-78c587836bb0 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:42:57.600139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:57.602278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:57.608450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.608928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.609353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.610032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.610674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.611125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.663244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-edf4f65a-41d6-40d7-bdfa-d9a99f660cdb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "POST /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0/action" status: 202 len: 0 microversion: 2.1 time: 0.352217 Sep 05 14:42:57.664504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 466/953] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:42:57 2022] POST /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0/action => generated 0 bytes in 355 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:42:57.675441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:57.676607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:57.684647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.685783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.686577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.688371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:57.688942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:57.689468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:57.808708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e95f2e72-a6bc-4120-81ed-19b247374910 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.212884 Sep 05 14:42:57.809469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 488/954] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:42:57.886646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:42:57.899828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b1b48adc-f154-449e-ae11-2f7805f23e6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.230285 Sep 05 14:42:57.900442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 467/955] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:42:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:42:58.075331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:58.077749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:58.083739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.084479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.084903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.085924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.086567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.087179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.122724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fbfe3b2a-54ff-4490-a4a6-eee7fce43d84 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051380 Sep 05 14:42:58.123321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 489/956] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:42:58.361421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:58.364127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:58.370504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.371025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.371486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.372166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.372611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.373027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.401516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d02f8dad-4301-4672-bebd-14bd442960f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044158 Sep 05 14:42:58.402292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 468/957] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:58.820875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:58.823023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:58.830011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.830504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.830982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.831709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.832710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.833187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.862432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ba97d7f6-2eb4-4c14-aa7e-70dac45ad7d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045371 Sep 05 14:42:58.862993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 490/958] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:58.925434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:58.926180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:58.932085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.932567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.933002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:58.933687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:58.934143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:58.934570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.135901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:59.138040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:59.144297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:59.145399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:59.145832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.146520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:59.146999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:59.147473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.161135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:42:59.173367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6f336953-e9cf-44a7-a0ba-ede7d1ad796a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.251375 Sep 05 14:42:59.192661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-34a4d6c9-aafe-4d6e-a5ca-48de04affc07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060823 Sep 05 14:42:59.192904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 469/959] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:42:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:42:59.193354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 491/960] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:42:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:42:59.415351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:59.417390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:59.423938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:59.424412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:59.424840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.425520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:59.426477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:59.426923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.458942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f5b42e79-cdbf-4c7c-92a6-fd95ffe7054d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049186 Sep 05 14:42:59.459501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 470/961] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:42:59.874599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:42:59.877279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:42:59.883503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:59.883977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:59.884408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.885090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:42:59.885535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:42:59.885953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:42:59.915380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e1db71d-bcd9-4757-903c-ea5ef4af17ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044872 Sep 05 14:42:59.915935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 492/962] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:42:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:00.196487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:00.197122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:00.203316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.203801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.204230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.204912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.205725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.205867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:00.205980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.208060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:00.213997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.214475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.214937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.215626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.216073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.216491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.247767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd87e4d3-9d25-4b1d-a0a2-bca731735bf7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046155 Sep 05 14:43:00.248394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 493/963] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:00.335784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:00.343677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6e288429-e3db-4793-8880-6b7a1df0ae04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151018 Sep 05 14:43:00.344229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 471/964] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:00.471390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:00.474338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:00.480304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.480784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.481212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.481971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.482418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.482867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.513591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a400e011-cfe3-4ac1-8137-e15d80ee17ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046155 Sep 05 14:43:00.514157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 494/965] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:00.928187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:00.930403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:00.936855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.937333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.937766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.938506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:00.938984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:00.939409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:00.970018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-568e72ea-80e5-4015-b91f-45f36d60a071 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046271 Sep 05 14:43:00.970750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 472/966] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:01.260541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:01.262727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:01.269225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.269701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.270134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.270839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.271297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.271721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.300283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0fa80ab5-7857-4698-bb38-3bc34db095d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043768 Sep 05 14:43:01.301481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 495/967] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:01.368949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:01.371357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:01.375429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.375926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.376356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.377029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.377476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.377891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.509324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:01.517196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56e12a19-ad42-42a2-9a0f-8471a61416d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152010 Sep 05 14:43:01.517697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 473/968] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:01.525511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:01.527666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:01.533521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.534057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.534497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.535712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.536182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.536594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.565235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5bc65d8c-7216-4dae-8733-7106c6a71f47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Sep 05 14:43:01.565764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 496/969] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:01.983239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:01.985823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:01.992268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.992745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.993173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:01.993853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:01.994308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:01.994718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.024547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0d1909d2-2d4e-403e-998e-9a3686506d24 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045815 Sep 05 14:43:02.025094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 474/970] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:02.313557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:02.315684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:02.322618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:02.323131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:02.323566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.324255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:02.324705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:02.325125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.349763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:02.354358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d95ecded-c858-4bb9-bf72-8e61e530f61d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044794 Sep 05 14:43:02.354929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 497/971] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:02.540060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:02.540670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:02.546582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:02.547091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:02.547557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.548273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:02.548730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:02.549154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.553745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:02.578135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:02.580343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:02.586332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:02.586886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:02.591964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.591964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:02.591964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:02.591964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:02.619868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-86bd6478-32d2-441c-bf90-7b880f9bbb43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046191 Sep 05 14:43:02.620652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 498/972] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:02.683050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:02.690478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4a41aa42-c405-440e-ab0b-b9c086940bf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154314 Sep 05 14:43:02.691059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 475/973] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:03.037751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:03.040042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:03.046485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.046840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.047275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.048306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.048767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.049307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.081867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3b6bf135-14f0-43d9-8486-80d3e1c124bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048718 Sep 05 14:43:03.082463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 499/974] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:03.366734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:03.368830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:03.375665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.376140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.376567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.377244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.377689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.378107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.406714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aab53e55-1506-4ba6-be92-9c193320a97b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044126 Sep 05 14:43:03.407292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 476/975] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:03.633495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:03.635584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:03.641914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.642384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.642828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.643506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.643956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.644452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.675125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70815dac-0b14-485c-b686-3317213ae7e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047171 Sep 05 14:43:03.675933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 500/976] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:03.714285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:03.714926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:03.720753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.721237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.721667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.722349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:03.723117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:03.723539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:03.854585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:03.862226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-026b98ae-b2ea-4048-ae50-904e402590b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151942 Sep 05 14:43:03.862808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 477/977] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:04.095105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:04.097396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:04.103608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.104081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.104634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.105316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.105759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.106173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.135483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-847aa2a8-e776-4384-b817-4650baa2ad50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045893 Sep 05 14:43:04.136023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 501/978] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:04.419603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:04.421695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:04.428692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.429172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.429604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.430294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.430743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.431188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.459405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e8ed34a8-c2ad-44c2-9974-8ac4cf61a5ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044009 Sep 05 14:43:04.459946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 478/979] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:04.687513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:04.689595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:04.695932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.696667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.697099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.697800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.698246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.698658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.728386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ddec7748-d435-46c9-8a28-9065344a6585 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044856 Sep 05 14:43:04.728970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 502/980] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:04.885099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:04.885710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:04.891838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.892317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.892808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:04.893550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:04.894005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:04.894426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.022976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:05.030689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-295a1485-7b70-490a-aa23-8ae1cb450789 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149632 Sep 05 14:43:05.031282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 479/981] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:05.148203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:05.150379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:05.156230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:05.156749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:05.157182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.157865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:05.158315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:05.158734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.201248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-32362094-57f1-4daf-affa-09cb4c81d7af tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057595 Sep 05 14:43:05.201798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 503/982] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:05.472017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:05.474585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:05.481180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:05.481657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:05.482092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.482894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:05.483404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:05.483876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.514323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8af61ae3-1477-4114-81e0-120903922998 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046373 Sep 05 14:43:05.514883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 480/983] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:05.741452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:05.743625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:05.749979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:05.750457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:05.750911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.751590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:05.752043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:05.752479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:05.781121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8834b932-c418-4217-b5b4-8b68af10d885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044265 Sep 05 14:43:05.781650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 504/984] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:06.059575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:06.060104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:06.065955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.066435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.066895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.067653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.068064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.068484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.200522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:06.208860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7aa2fd92-9b60-4438-8ab7-1c21d99624c4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152677 Sep 05 14:43:06.209352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 481/985] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:06.214716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:06.217101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:06.223237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.223784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.224875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.225559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.226014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.226434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.255117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4880a57a-0a16-4893-bf67-3b4c9b94d991 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044394 Sep 05 14:43:06.255667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 505/986] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:06.527921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:06.530044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:06.536890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.537370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.537804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.538487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.538975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.539400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.568852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a4d2baf-a848-42bd-a118-895d3a546f7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044968 Sep 05 14:43:06.569408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 482/987] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:06.793507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:06.795693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:06.802063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.802543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.803014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.803700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:06.804151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:06.804572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:06.834137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4d174286-0f2c-4edc-a94b-f99865b0e21b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043996 Sep 05 14:43:06.834667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 506/988] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:07.233424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:07.234067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:07.240507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.241010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.241440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.242120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.242613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.243042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.267990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:07.270265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:07.287853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.288335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.288768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.289463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.289916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.290343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.320596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6b8cc4dd-4347-40f6-83c9-b2f0ef0b5855 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056220 Sep 05 14:43:07.320740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 507/989] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:07.373930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:07.381700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c64b4fb4-4551-4855-a8b4-dae91943884f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152470 Sep 05 14:43:07.382255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 483/990] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:07.581339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:07.583474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:07.589291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.589764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.590197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.590895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.591345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.591761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.621405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57614711-1239-4e5f-af57-b8d6d920d29a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044024 Sep 05 14:43:07.621990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 508/991] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:07.846459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:07.848878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:07.855822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.857031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.857462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.858565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:07.859048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:07.859472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:07.888145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a86e4a94-f26e-46ba-8b49-a3736a97117e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045557 Sep 05 14:43:07.888640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 484/992] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:08.332548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:08.335435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:08.342128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.342686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.343381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.344116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.344807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.345414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.376296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c604fcf1-59f9-4f14-9837-5c3e6420682f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047709 Sep 05 14:43:08.377153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 509/993] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:08.403745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:08.404462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:08.410693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.411210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.411642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.412332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.412788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.413233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.634127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:08.636274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:08.642210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.643027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.643464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.644150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.644596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.645011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.651154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:08.659112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-844fef01-dc37-4de8-8638-f15841f68fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.259157 Sep 05 14:43:08.659897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 485/994] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:08.676064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-688c6eba-6e98-413a-b87e-f847328bc81b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045980 Sep 05 14:43:08.676623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 510/995] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:08.900949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:08.903114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:08.909418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.909895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.910324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.911037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:08.911490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:08.911912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:08.940171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0114cb9f-e8b0-4833-a18e-459ad7c52fe8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Sep 05 14:43:08.940708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 486/996] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:09.389393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:09.391683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:09.395172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:09.398522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.399035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.400832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.400832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.400832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.401336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.430677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ff21a68-8d9e-4dfe-b02e-b567246c720b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045174 Sep 05 14:43:09.431257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 511/997] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:09.684531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:09.685066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:09.688361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=92 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:09.690403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:09.692607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:09.694470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.695102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.695624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.696329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.697013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.701613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.701751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.701751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.701751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.701751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.702123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.702123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.730834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6bc4e8d-100b-4142-b72a-5af768a68c60 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044339 Sep 05 14:43:09.731401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 512/998] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:09.826780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:09.834371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7ddfbfb-ca13-4f67-9378-4e9e3197f01b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153837 Sep 05 14:43:09.834943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 487/999] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:09.952942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:09.955013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:09.961368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.961851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.962284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.963019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:09.963475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:09.963897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:09.992585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1d2f1942-22fd-469d-b59b-0e96a24a857d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Sep 05 14:43:09.993117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 513/1000] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:10.443642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:10.447269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:10.453701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:10.454183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:10.454612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:10.455328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:10.455776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:10.456200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:10.485656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-359badd8-502f-4918-8940-117821804db3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046567 Sep 05 14:43:10.486221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 488/1001] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:10.743273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:10.745433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:10.751731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:10.752209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:10.752642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:10.753320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:10.753771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:10.754187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:10.770126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:10.783102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c99aa1c6-7370-4ee1-9900-fde64dfa09da tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043802 Sep 05 14:43:10.783643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 514/1002] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:10.857944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:10.858609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:10.864695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:10.865158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:10.865594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:10.866310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:10.866762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:10.867245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:10.994806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:11.002534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2fc4d739-fc36-4d4c-8b4e-a835ad881712 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148707 Sep 05 14:43:11.003128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 489/1003] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:11.003772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:11.006548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:11.012749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:11.013226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:11.013656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:11.014396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:11.014870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:11.015291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:11.044594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3327f11c-b437-415e-962e-477934a840cc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044680 Sep 05 14:43:11.045130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 515/1004] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:11.498011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:11.500160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:11.506478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:11.506991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:11.507420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:11.508097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:11.508545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:11.508964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:11.538096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4abfdbf6-70d3-4adf-940a-1d2bf94374f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043629 Sep 05 14:43:11.538644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 490/1005] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:11.796403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:11.798445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:11.805345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:11.805847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:11.806278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:11.807049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:11.807500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:11.807919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:11.836235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f6afa951-6302-46b1-a1c9-6d64206a8ddc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044068 Sep 05 14:43:11.836774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 516/1006] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:12.025729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:12.026377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:12.032392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.032875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.033311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.033997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.034449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.034903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.057629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:12.059839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:12.065670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.066155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.066592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.067310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.067762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.068187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.098088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d107ddf7-6949-4e6e-b30b-dc00b46f3e2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044668 Sep 05 14:43:12.098650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 517/1007] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:12.168901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:12.172332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:12.201641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dfbfba8e-85e8-452b-a995-b8cfc0eafcef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155106 Sep 05 14:43:12.201641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 491/1008] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:12.549704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:12.551905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:12.558739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.560978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.560978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.560978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.560978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.561329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.589635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c3bd48a-f313-430c-b4ae-8126e2f08f48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043891 Sep 05 14:43:12.590181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 518/1009] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:12.850148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:12.852224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:12.858996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.859483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.859916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.860595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:12.861070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:12.861491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:12.890293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96f9a83d-3ed6-4d5b-abf6-a7ef3adbe07f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045634 Sep 05 14:43:12.890849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 492/1010] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:13.111128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:13.113203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:13.119654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.120137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.120571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.121251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.121745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.122172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.152986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8f0f9a6-8bcd-4102-9141-b7419432d840 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046014 Sep 05 14:43:13.153532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 519/1011] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:13.222591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:13.223516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:13.229964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.230439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.230900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.231573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.232018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.232434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.358911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:13.366525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5b19c35f-9400-4d24-9c80-f50c0885d2e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147647 Sep 05 14:43:13.367065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 493/1012] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:13.479256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-6c2c6497-3a79-463a-8dc9-a4d90a42752f req-8ad9179b-df72-49a2-bccd-661229ae799a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0921c73a-ed22-41a2-b38f-78c587836bb0", "name": "network-vif-unplugged", "status": "completed", "tag": "5adb0041-9b7d-4fe6-9f1c-cb637443eb6e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:43:13.488418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-6c2c6497-3a79-463a-8dc9-a4d90a42752f req-8ad9179b-df72-49a2-bccd-661229ae799a service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.488888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-6c2c6497-3a79-463a-8dc9-a4d90a42752f req-8ad9179b-df72-49a2-bccd-661229ae799a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.489309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-6c2c6497-3a79-463a-8dc9-a4d90a42752f req-8ad9179b-df72-49a2-bccd-661229ae799a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.499811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-6c2c6497-3a79-463a-8dc9-a4d90a42752f req-8ad9179b-df72-49a2-bccd-661229ae799a service nova] Creating event network-vif-unplugged:5adb0041-9b7d-4fe6-9f1c-cb637443eb6e for instance 0921c73a-ed22-41a2-b38f-78c587836bb0 on hv-cinder-84290 Sep 05 14:43:13.504793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-6c2c6497-3a79-463a-8dc9-a4d90a42752f req-8ad9179b-df72-49a2-bccd-661229ae799a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029218 Sep 05 14:43:13.505436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 520/1013] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:13.602647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:13.607514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:13.610990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.611463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.611889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.612571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.613048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.613461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.643195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-290a9761-fbad-434c-968c-97de3bd12318 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045391 Sep 05 14:43:13.644005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 494/1014] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:13.904308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:13.906448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:13.913167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.913641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.914099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.914771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:13.915244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:13.915661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:13.943381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7bfa105b-d30e-44c1-a48c-296cbbd5a1ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043667 Sep 05 14:43:13.943908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 521/1015] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:14.165358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:14.167472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:14.173376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.173857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.174298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.175015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.175469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.175892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.204779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3060b62f-35c1-4c32-8a94-7a2c8e5eae63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043455 Sep 05 14:43:14.205314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 495/1016] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:14.389833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:14.390438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:14.396854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.397333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.397764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.398442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.398926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.399349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.531476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:14.539066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ea5fe499-391a-47bb-bc28-81bb56769ed4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153060 Sep 05 14:43:14.539625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 522/1017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:14.656067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:14.658186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:14.664540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.665043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.665477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.666156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.666606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.667049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.696120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c9e1c74e-a859-46de-8123-b4609eac109d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044020 Sep 05 14:43:14.696660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 496/1018] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:14.956281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:14.958344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:14.964573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.965065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.965498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.966183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:14.966636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:14.967091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:14.996943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-39129c71-dcda-46a4-a82c-5b408dcd7606 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044696 Sep 05 14:43:14.997493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 523/1019] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:15.217595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:15.219775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:15.225872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:15.226361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:15.226777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:15.227472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:15.227920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:15.228340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:15.257774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-76724cbe-4903-45fa-9337-a15077176396 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044194 Sep 05 14:43:15.258326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 497/1020] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:15.562165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:15.562682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:15.569042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:15.569520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:15.569949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:15.570633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:15.571115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:15.571536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:15.698752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:15.706596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-db82b936-f88d-4bb7-94f3-8773be3619d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148383 Sep 05 14:43:15.707190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 524/1021] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:15.708771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:15.710982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:15.717678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:15.718153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:15.718578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:15.719281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:15.719732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:15.720147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:15.749513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b439d189-eb60-4720-9015-1f6134fedeb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045102 Sep 05 14:43:15.750060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 498/1022] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:16.009416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:16.011569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:16.017471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.017962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.018368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.019116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.019561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.020357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.050062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-615f5c2c-30d9-4df9-88ab-6dc3b5f92bdb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044814 Sep 05 14:43:16.050603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 525/1023] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:16.270274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:16.272450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:16.278645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.279165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.279605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.280317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.280773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.281198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.311387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c338e969-e105-4133-a1ae-f94587b5faaf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045328 Sep 05 14:43:16.311969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 499/1024] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:16.730366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:16.731045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:16.737157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.737661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.738103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.738833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.739343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.739832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.761242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:16.763481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:16.769728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.770206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.770632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.771840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:16.772282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:16.772698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:16.801874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2dee5d70-cd70-4f38-8f0e-9cbaf939848d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044534 Sep 05 14:43:16.802445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 500/1025] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:16.868513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:16.876130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a9aaaea-fb82-47af-b18a-68e7dbcb77a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149915 Sep 05 14:43:16.876678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 526/1026] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:17.062485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:17.064696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:17.070565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.071146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.071622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.072314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.072768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.073187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.103318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-30c9e934-dd46-4b1e-ac84-31ba7e14a43f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044723 Sep 05 14:43:17.103874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 501/1027] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:17.323804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:17.325979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:17.332398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.332876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.333307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.333989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.334440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.334884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.363781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0911327-cd11-41fd-ad43-82a3d592a1f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044027 Sep 05 14:43:17.364323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 527/1028] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:17.814301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:17.816474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:17.823528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.823999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.824428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.825098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.825542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.825967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.855340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5d66d5db-1cf4-45bf-b1f6-10c7e3c4f98e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045096 Sep 05 14:43:17.855887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 502/1029] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:17.898704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:17.899379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:17.912650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.913133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.913566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:17.914258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:17.914711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:17.915192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.051272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:18.059487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e85fbd1-67dd-4163-8c62-f74129ebf2f1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.165185 Sep 05 14:43:18.063357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 528/1030] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:18.116545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:18.118640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:18.124514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:18.124987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:18.125416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.126441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:18.126925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:18.127347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.156866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-64f2b22c-c14e-4ab1-90eb-ad9a7e8b722b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044960 Sep 05 14:43:18.157406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 503/1031] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:18.377023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:18.379166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:18.385458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:18.385929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:18.386365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.387097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:18.387621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:18.388038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.417196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d64f0294-351e-42c7-aa97-80056568c753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Sep 05 14:43:18.417728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 529/1032] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:18.868198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:18.870362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:18.876714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:18.877186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:18.877611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.878290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:18.878735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:18.879174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:18.907930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1aeffb5d-943c-4c1b-8048-12ffef2cdbce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Sep 05 14:43:18.908462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 504/1033] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:19.082664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:19.083296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:19.089153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:19.089636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:19.090062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:19.090735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:19.091209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:19.091630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:19.169950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:19.172097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:19.178502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:19.179055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:19.179490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:19.180170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:19.180615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:19.181507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:19.211044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-598aba10-42ef-44fd-a997-7d70e7bcd930 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045303 Sep 05 14:43:19.211595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 505/1034] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:19.220321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:19.228210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5708dc74-da70-4d38-a1fb-b99b335d4408 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149442 Sep 05 14:43:19.228763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 530/1035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:19.429889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:19.431994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:19.437792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:19.438269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:19.438697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:19.439402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:19.439849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:19.440264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:19.469174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9380ec52-faaf-4ffe-8786-d85f2db80501 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043973 Sep 05 14:43:19.469717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 506/1036] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:20.049433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:20.051719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:20.057715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.058224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.058658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.059374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.059827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.060248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.085726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:20.090397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d06847cd-cd66-44ff-896e-c3e322f3a1b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.173525 Sep 05 14:43:20.090982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 531/1037] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:20.223912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:20.226035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:20.232392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.232865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.233295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.233967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.234412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.234847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.251302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:20.251920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:20.258775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.259280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.259714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.260398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.260851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.261278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.264906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-60d00e17-bca6-4db9-ada5-9ccb871e9f71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045268 Sep 05 14:43:20.265452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 507/1038] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:20.396534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:20.404261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c87a894a-f620-4f35-b673-6e82d751ef64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156764 Sep 05 14:43:20.404820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 532/1039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:43:20.482484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:20.484565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:20.491125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.491599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.492027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.492705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:20.493154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:20.493573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:20.510384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:20.522828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6c78a470-92a9-43e1-bdf0-5822716ccf12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Sep 05 14:43:20.531637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 508/1040] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:21.103913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:21.106126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:21.112604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.113077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.113506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.114188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.114638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.115100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.142806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ffa21b4-3606-4cdd-ba23-0967cf5a7013 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043505 Sep 05 14:43:21.143355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 533/1041] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:21.281836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:21.283969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:21.291377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.291846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.292273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.292945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.293388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.293799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.321678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-36ba3d40-3744-47af-a903-2ab96aebb854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043836 Sep 05 14:43:21.322214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 509/1042] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:21.427177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:21.427691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:21.434237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.434596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.435058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.435736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.436191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.436608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.542126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:21.544359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:21.552807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.553303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.553775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.555183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:21.555933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:21.556052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:21.585853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b3e26998-86a2-433b-8169-d55ee26a71db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048129 Sep 05 14:43:21.586411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 510/1043] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:21.652663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:21.661088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-33833f6c-0a43-44a6-84a0-43f498de7fe8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.237860 Sep 05 14:43:21.661640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 534/1044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:22.155022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:22.157143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:22.163832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.164356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.164790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.165479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.165947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.166390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.196354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2903ce01-47c6-4a7a-8bd0-d016c2af1f0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045245 Sep 05 14:43:22.196838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 511/1045] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:22.333873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:22.336601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:22.342975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.343449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.343875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.344547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.345004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.345410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.373986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d6ef695d-1c53-4416-abc1-b9000945bcbc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044082 Sep 05 14:43:22.374523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 535/1046] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:22.597753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:22.600266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:22.606564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.607064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.607493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.608205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.608650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.609066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.638434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d6d05729-c686-47ea-92ad-9b09c1f11f7b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044783 Sep 05 14:43:22.639067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 512/1047] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:22.685055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:22.685693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:22.691949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.692429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.692861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.693539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:22.693991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:22.695084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:22.821362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:22.828993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d0f4ac76-bcda-48e3-af69-710268978445 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147907 Sep 05 14:43:22.829549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 536/1048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:23.208826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:23.211119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:23.216936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.217413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.217839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.218512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.218989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.219405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.248277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d33be089-b8a2-423d-84a0-b96183649a81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043441 Sep 05 14:43:23.248830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 513/1049] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:23.386938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:23.389066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:23.395411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.395889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.396321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.397009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.397461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.397878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.426407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f5cc881-17d6-4f4b-945b-25bcba5f6b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044130 Sep 05 14:43:23.426978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 537/1050] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:23.650936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:23.652997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:23.659607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.660088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.660542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.661226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.661676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.662094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.691006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-20941376-0117-4a03-9a4b-601b2345ced7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044133 Sep 05 14:43:23.691544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 514/1051] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:23.852436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:23.853047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:23.858922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.859408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.859841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.860520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:23.860973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:23.861390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:23.988777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:23.999560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a9603a6-1126-483a-be0b-b77d391d24e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151308 Sep 05 14:43:24.000131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 538/1052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:24.260907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:24.263059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:24.268984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:24.269462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:24.269898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:24.270580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:24.271134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:24.271556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:24.300572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e8479da7-5180-40d1-871f-df691c54546c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043727 Sep 05 14:43:24.301106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 515/1053] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:24.439526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:24.441684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:24.448681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:24.449173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:24.449596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:24.450281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:24.450731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:24.451178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:24.480665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0ac4715b-209c-4f90-9085-378ae8360498 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045135 Sep 05 14:43:24.481207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 539/1054] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:24.704036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:24.706189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:24.713109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:24.713585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:24.714054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:24.714767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:24.715245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:24.715667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:24.744294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b8029286-9526-47e9-aec9-ec2db64294bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Sep 05 14:43:24.744844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 516/1055] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:25.022019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:25.022685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:25.028648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.029126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.029551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.030227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.030681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.031125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.169357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:25.178738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-372bb60c-e7ad-4502-8eef-4c6303a3d3e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.160389 Sep 05 14:43:25.179342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 540/1056] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:43:25.313438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:25.315496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:25.321378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.321924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.322355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.323058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.323503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.323920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.351903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-709ac4bf-cac0-4876-95dd-c55773e4982f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042534 Sep 05 14:43:25.352435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 517/1057] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:25.493140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:25.495911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:25.502095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.502573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.503043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.503724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.504178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.504605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.533517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-51b6c050-2a06-42dd-a859-6c43123bf470 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044411 Sep 05 14:43:25.534052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 541/1058] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:25.756656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:25.758807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:25.765129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.765598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.766023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.766694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:25.767165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:25.767581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:25.797012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0e446ec6-45ab-4acc-ad54-07fd7779aaaa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044306 Sep 05 14:43:25.797544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 518/1059] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:26.203463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:26.204064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:26.209968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.210443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.210895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.211570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.212016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.212446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.339251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:26.346890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-43104736-6a85-4d88-8b46-5c7169ef8941 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147233 Sep 05 14:43:26.347387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 542/1060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:26.364621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:26.366732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:26.372561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.373036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.373464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.374144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.374617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.375066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.403208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-826778ae-eaad-4192-a4ed-bb3e2af94e82 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042446 Sep 05 14:43:26.403812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 519/1061] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:26.546455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:26.548787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:26.555230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.555712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.556148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.556865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.557320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.557773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.587077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-922ca288-06af-4ee0-b1a4-3dae8d2636b8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044722 Sep 05 14:43:26.588157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 543/1062] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:26.809045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:26.811202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:26.817562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.818037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.818466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.819171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:26.819620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:26.820035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:26.849727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f2221113-e1c9-4adc-9be9-a2a3b6e6d2c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044631 Sep 05 14:43:26.850254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 520/1063] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:27.370549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:27.371105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:27.377182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.377686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.378129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.378856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.379316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.379739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.415749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:27.418463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:27.420769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:43:27.420920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:43:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments (ip 10.222.0.15) !!! Sep 05 14:43:27.428849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.429335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.429771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.430464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.430975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.431428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.461172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a942f1c6-bacd-443d-a15a-063d86159965 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049449 Sep 05 14:43:27.461738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 521/1064] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:27.514217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:27.521746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1fc81ad4-f31b-4fc8-a22b-c37983af02ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156130 Sep 05 14:43:27.522282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 544/1065] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:27.599629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:27.601774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:27.608260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.608736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.609172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.609853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.610305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.610731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.639458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24712116-754e-45f2-ae36-97621ae42fe1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044148 Sep 05 14:43:27.639938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 522/1066] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:27.862165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:27.864341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:27.871344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.871831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.872264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.872947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:27.873399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:27.873819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:27.901809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1eb7f1c3-e957-4c85-8002-9dfed6fd1394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043599 Sep 05 14:43:27.902279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 545/1067] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:28.473823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:28.476007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:28.483252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.483672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.484104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.484790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.485241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.485666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.514497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4b8f36d4-0868-42a9-8051-1afda323eb4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044880 Sep 05 14:43:28.515079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 523/1068] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:28.545680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:28.546285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:28.552257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.552733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.553159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.553834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.555034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.555495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.652735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:28.655495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:28.662475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.663079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.665353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.665353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.665353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.665353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.689509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:28.694954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-342552bc-ca42-427f-8413-03a578b61e09 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046822 Sep 05 14:43:28.695524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 524/1069] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:28.697399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ea56006a-7b9e-4356-bf48-b4fa671bedaf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155935 Sep 05 14:43:28.697951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 546/1070] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:28.913403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:28.915576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:28.921958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.922435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.922893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.923572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:28.924045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:28.924461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:28.928016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:28.953850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49a49812-9479-424d-949b-beb0734d0065 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044338 Sep 05 14:43:28.954617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 525/1071] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:29.526587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:29.529338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:29.535636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.536116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.536554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.537236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.537688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.538106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.566101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7f34f3ef-970b-4e86-9a5f-e0beb5ac8de4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043565 Sep 05 14:43:29.566636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 547/1072] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:29.708031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:29.710196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:29.718412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.718918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.719636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.720350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.720689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:29.721263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.721382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:29.721692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.729111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.729481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.729918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.730605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.731149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.731507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.751792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:29.752791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3f92638-19e8-4199-bba8-9a18da3acf80 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048674 Sep 05 14:43:29.753366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 526/1073] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:29.867082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:29.875232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b5ccfb9a-9264-4411-bbb8-08d24948cea5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.158516 Sep 05 14:43:29.875784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 548/1074] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:43:29.965582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:29.967720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:29.973829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.974307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.974738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:29.975451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:29.975907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:29.976328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:30.005543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24887173-97f2-4402-9630-984f11e7b522 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043916 Sep 05 14:43:30.006082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 527/1075] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:30.579531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:30.581713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:30.588234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:30.588713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:30.589151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:30.589831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:30.590283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:30.590704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:30.618800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7b8b7ebe-0278-46c7-8069-0205a1d3a205 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043240 Sep 05 14:43:30.619348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 549/1076] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:30.765309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:30.767443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:30.773790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:30.774257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:30.774680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:30.775419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:30.775864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:30.776276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:30.804758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2735823f-763d-4147-830d-8153ae89bf9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043434 Sep 05 14:43:30.805294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 528/1077] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:30.898284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:30.898850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:30.904760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:30.905237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:30.905667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:30.906347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:30.906813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:30.907243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.018069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:31.020278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:31.026014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:31.026489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:31.026969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.027647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:31.028091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:31.028505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.037305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:31.045531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-94f5d266-6ca7-4a3c-9b44-a47f4eca7340 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151128 Sep 05 14:43:31.046098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 550/1078] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:31.059299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3b0a0eee-652c-401e-adff-7875a57b4df1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045127 Sep 05 14:43:31.059839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 529/1079] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:31.631694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:31.633845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:31.640740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:31.641221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:31.641650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.642325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:31.642776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:31.643220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.672129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-597f5625-5919-487b-84f3-e3a0112e75f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044329 Sep 05 14:43:31.672600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 551/1080] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:31.818015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:31.820306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:31.827300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:31.827775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:31.828203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.828917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:31.829364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:31.829781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:31.858966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6e0e7954-78a1-42e6-8936-a0ef04cba94d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044923 Sep 05 14:43:31.859511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 530/1081] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:32.068809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:32.069415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:32.071244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:32.073523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:32.076561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.077065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.077571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.078264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.078721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.079266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.080726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.081216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.081654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.082355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.082844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.083277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.113305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bf099cd7-314e-4941-9dfa-23aed6ccb86a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045878 Sep 05 14:43:32.114028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 531/1082] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:32.210072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:32.217812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b77e80c6-43d8-4afe-a38d-4022cd7637e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152888 Sep 05 14:43:32.218367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 552/1083] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:32.684624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:32.686732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:32.692680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.693154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.693581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.694257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.694701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.695143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.724168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a71d72af-ceff-41fb-a65f-9a2e5dc19167 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Sep 05 14:43:32.724719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 532/1084] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:32.871785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:32.873929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:32.880322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.880801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.881232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.881912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:32.882363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:32.882805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:32.911409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-904cb80c-c70b-4518-9abc-a96d27b692c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043668 Sep 05 14:43:32.911933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 553/1085] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:33.126383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:33.128484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:33.134776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.135283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.135727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.136434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.136896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.137309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.165484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1e9f7ca2-3b7a-47a3-b767-b138d1619a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043137 Sep 05 14:43:33.166027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 533/1086] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:33.241468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:33.242075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:33.248615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.249092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.249517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.250195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.250638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.251079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.380329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:33.388129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b173c1d0-7584-4ca4-8ac6-2f586da6a22c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150569 Sep 05 14:43:33.388683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 554/1087] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:33.736509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:33.738651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:33.744635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.745117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.745551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.746237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.746694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.747152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.775613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1b530fa0-c229-47c0-9c75-b2dca7df75a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043070 Sep 05 14:43:33.776161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 534/1088] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:33.923826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:33.925963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:33.932265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.932740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.933166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.933844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:33.934286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:33.934699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:33.963019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-50f82088-2abc-4565-8a68-503ab62140fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043154 Sep 05 14:43:33.963563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 555/1089] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:34.178437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:34.180554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:34.187387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.187866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.188300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.188984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.189436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.189865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.218517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eca274fe-c11f-461c-89b8-bcc625ed3d51 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044232 Sep 05 14:43:34.219096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 535/1090] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:34.415881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:34.416514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:34.428232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.428767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.429172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.429859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.430480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.431066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.558416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:34.566814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c89e24f-a52f-4eaf-870d-5f4842f34e55 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.157307 Sep 05 14:43:34.567387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 556/1091] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:34.788805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:34.790995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:34.797475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.797953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.798387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.799102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.799556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.799979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.828559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2c46c522-35c8-4872-8e01-731b51844e74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043677 Sep 05 14:43:34.829099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 536/1092] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:34.976524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:34.979267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:34.985630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.986101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.986527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:34.987245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:34.987693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:34.988115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.016618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a2913e61-e50b-44f2-bce9-a48c954c1766 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044366 Sep 05 14:43:35.017164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 557/1093] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:35.231022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:35.233157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:35.235495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:35.240139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:35.240624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:35.241064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.241816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:35.242275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:35.242705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.272124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-82483469-3093-40d7-912d-090b917af812 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Sep 05 14:43:35.272669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 537/1094] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:35.590486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:35.591134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:35.597045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:35.597516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:35.597948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.598919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:35.599368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:35.599782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.730174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:35.737968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6b9a5ca-17f1-4369-a538-b3c1e5918d0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151919 Sep 05 14:43:35.738524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 558/1095] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:35.840917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:35.843018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:35.849446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:35.849924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:35.850364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.851068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:35.851522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:35.851946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:35.880078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d9c3d074-b478-4e4f-a67a-ec43f86eba0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Sep 05 14:43:35.880616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 538/1096] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:36.029662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:36.031830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:36.038091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.038568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.053331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.053331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.053331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.053331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.068994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0b41aae-86e7-4c38-8e19-d228d593994f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044123 Sep 05 14:43:36.069546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 559/1097] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:36.285182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:36.287336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:36.293699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.294203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.294636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.295360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.295805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.296220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.324386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1ff9712a-b23a-43e7-be6f-b79d884abcf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043149 Sep 05 14:43:36.324931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 539/1098] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:36.761394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:36.761984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:36.768104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.768583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.769017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.769693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.770144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.770561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.892366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:36.894504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:36.896884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:36.900456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.900940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.901366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.902050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:36.902495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:36.902932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:36.904849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-772511f3-785e-4566-9def-d928cc306d40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147371 Sep 05 14:43:36.905486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 560/1099] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:36.932278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-613943ad-dbfa-4468-ab34-48b0f07bf06b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Sep 05 14:43:36.932816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 540/1100] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:37.081823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:37.083957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:37.086242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:37.090957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.091440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.091870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.092554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.093004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.093424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.124295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8b4ea47e-ad02-4e4d-9d3f-0e3279cb09bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046612 Sep 05 14:43:37.124842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 561/1101] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:37.337524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:37.339580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:37.345809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.346285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.346717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.347424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.347874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.348549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.374041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:37.378578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e424a9c9-11d0-49af-9759-c798c2b84654 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045135 Sep 05 14:43:37.379168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 541/1102] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:37.929031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:37.929634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:37.935641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.936118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.936579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.937259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.937713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.938133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.944415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:37.946556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:37.953374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.953851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.954278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.954994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:37.955445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:37.955862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:37.985818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-46fa1c23-d9ad-4508-be22-b887ca194b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045305 Sep 05 14:43:37.986484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 542/1103] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:38.064811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:38.072484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1b1ae58-b289-44a4-8f18-ae04a99e1de3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147379 Sep 05 14:43:38.073045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 562/1104] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:38.136957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:38.139679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:38.145590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:38.146060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:38.146485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:38.147179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:38.147624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:38.148040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:38.176799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc5c01ab-2d04-48fa-8ad0-e6d4574f7190 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043943 Sep 05 14:43:38.177334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 543/1105] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:38.391770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:38.393903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:38.400206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:38.400679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:38.401109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:38.401873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:38.402324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:38.402743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:38.432414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ac7047a6-4bd3-4b6b-9736-bfb8daf78a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045286 Sep 05 14:43:38.432956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 563/1106] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:38.997624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:38.999812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:39.006087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.006557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.007024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.007698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.008150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.008564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.037297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c42ab446-9a2e-4a28-9517-d652aaace617 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043663 Sep 05 14:43:39.037838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 544/1107] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:39.096609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:39.097211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:39.103376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.103967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.104399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.105078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.105567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.105983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.189336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:39.191507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:39.197481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.197960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.198388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.199097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.199552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.199967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.229612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2c26b3bc-c85c-4b32-9f79-a045ad96c771 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044293 Sep 05 14:43:39.230173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 545/1108] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:39.238467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:39.246062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf30f8b3-fbaa-48b3-9e9b-9f47fbb775fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153312 Sep 05 14:43:39.246605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 564/1109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:39.444976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:39.447111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:39.453528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.454010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.454441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.455153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:39.455605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:39.456026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:39.485560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-519661e2-64e3-4ec9-ae5a-6c4996e4e5d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044601 Sep 05 14:43:39.486100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 546/1110] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:40.049551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:40.051752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:40.058227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.058701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.063835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.063835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.063835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.063835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.064877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:40.090324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-edaa7e99-9877-4b5c-9455-7501036ec7a8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044681 Sep 05 14:43:40.090890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 565/1111] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:40.242976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:40.245095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:40.252093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.252572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.253002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.253679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.254128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.254546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.268843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:40.269452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:40.275465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.275948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.276381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.277064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.277515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.277934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.283113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-01a4cff5-7a16-4757-a42f-4282c4058c2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044209 Sep 05 14:43:40.283677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 547/1112] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:40.407582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:40.415198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ec14f7e-f9d0-4fae-b793-415bda113e64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150471 Sep 05 14:43:40.415762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 566/1113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:43:40.497583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:40.499774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:40.505611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.506107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.506523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.507238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:40.507717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:40.508133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:40.536988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ba3e87f4-6133-4ad7-a998-ca95b4441576 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043386 Sep 05 14:43:40.537531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 548/1114] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:41.102360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:41.104506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:41.110961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.111436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.111889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.112564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.113009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.113424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.141280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f475421-6384-44da-afdc-8ae07869ff05 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043134 Sep 05 14:43:41.141822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 567/1115] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:41.295581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:41.297722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:41.304150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.304620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.305047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.305719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.306162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.306576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.335815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bbd46003-4bc3-4237-bcad-aa68976614e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044218 Sep 05 14:43:41.336345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 549/1116] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:41.437929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:41.438456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:41.444285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.444756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.445181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.445854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.446299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.446715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.549550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:41.551819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:41.557817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.558370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.558896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.559663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:41.560209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:41.561206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:41.577921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:41.585772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-00480569-a00b-4f72-abf9-89a420800e5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152307 Sep 05 14:43:41.586425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 568/1117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:41.591214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e96b5ecd-09a5-445b-b2ae-63ebbf799efa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045725 Sep 05 14:43:41.591762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 550/1118] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:42.153714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:42.155874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:42.162271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.162742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.163202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.163875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.164319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.164734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.193144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7b85872e-73a5-4e33-addc-04fc2a02500b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043469 Sep 05 14:43:42.193677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 569/1119] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:42.348219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:42.350512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:42.356826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.357981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.358411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.359114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.359592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.360009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.389039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c7db6e1c-a7bc-41f5-bb7f-ffe9439081ae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044876 Sep 05 14:43:42.389579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 551/1120] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:42.604048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:42.606225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:42.609405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:42.610025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:42.613009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.613542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.613974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.614687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.615278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.615694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.615959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.616442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.616880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.617567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:42.618026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:42.618450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:42.644974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f4aff12e-1c5f-460d-8793-f1fb7d2d9a08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045063 Sep 05 14:43:42.645535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 570/1121] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:42.749438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:42.757122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6de25156-328e-40d8-8765-8891cd5bd999 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152056 Sep 05 14:43:42.757686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 552/1122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:43:43.206010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:43.208165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:43.214493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.215009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.215443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.216125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.216575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.217608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.246223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4034ca85-f5c7-4e32-ac6c-8479aafd1ced tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Sep 05 14:43:43.246882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 571/1123] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:43.401134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:43.403206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:43.410037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.410508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.410982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.411658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.412101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.412514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.585632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e80cd89a-77f8-4960-8b80-d03da93d1177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.188477 Sep 05 14:43:43.586222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 553/1124] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:43.657388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:43.659541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:43.665523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.666023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.666448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.667172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.667629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.668052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.697220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-71571fb1-e1e8-484c-8b0f-399f3649f447 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043903 Sep 05 14:43:43.697756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 572/1125] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:43.779682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:43.780277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:43.786060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.786531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.786995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.787671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:43.788115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:43.788529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:43.914049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:43.922314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d25cd679-6608-4477-aa33-1c789cf87541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.146443 Sep 05 14:43:43.922897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 554/1126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:44.258581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:44.260731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:44.267078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:44.267552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:44.267982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:44.268657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:44.269102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:44.269518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:44.298058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0a7a11ab-5ac0-4865-853e-273ba449299f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043423 Sep 05 14:43:44.298592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 573/1127] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:44.599342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:44.601504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:44.608582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:44.609062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:44.609497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:44.610183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:44.610640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:44.611103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:44.642870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ee042b15-3e93-4c4d-8965-92e818ba4064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047852 Sep 05 14:43:44.643448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 555/1128] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:44.710114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:44.712355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:44.718166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:44.718638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:44.719099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:44.719774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:44.720221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:44.720635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:44.750158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cb9964cf-9c9e-44f9-ae0b-918745187f0b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044022 Sep 05 14:43:44.750695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 574/1129] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:45.040648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:45.041259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:45.047855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.048322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.048751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.049434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.049940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.050360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.181373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:45.189150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4e208c74-f5be-4627-bb73-5881abd1b845 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.247460 Sep 05 14:43:45.189702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 556/1130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:45.310358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:45.312504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:45.318985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.319456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.319881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.320552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.320996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.321410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.351349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b2b6f671-4ab3-480b-a729-6c1a58f20458 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045015 Sep 05 14:43:45.352127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 575/1131] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:45.656051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:45.658223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:45.664608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.665087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.665521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.666204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.666655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.667110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.696026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4e440d5-1230-48c9-ae4b-a8ecbcee23a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044588 Sep 05 14:43:45.696555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 557/1132] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:45.762268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:45.765033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:45.770913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.771399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.771832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.772524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:45.772981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:45.773404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:45.802572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48c97301-b14d-4f60-aa95-cf791bd079de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043983 Sep 05 14:43:45.803314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 576/1133] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:46.212040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:46.212647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:46.218636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.219192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.219624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.220306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.220843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.221264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.239657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:46.353471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:46.360662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-826501d3-306c-41e9-a0d9-e7c8988851da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152597 Sep 05 14:43:46.361223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 558/1134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:46.366818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:46.369164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:46.376369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.376920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.377361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.378146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.378684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.379198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.410070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c4a971e-2005-4296-8ac0-371b61a83fa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049500 Sep 05 14:43:46.410647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 577/1135] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:46.708006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:46.710104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:46.716488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.717515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.717953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.718643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.719131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.719559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.750443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2d44cb11-a141-4288-b538-7637a9961524 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046504 Sep 05 14:43:46.751022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 559/1136] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:46.814723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:46.816888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:46.822836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.823323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.823756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.824431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:46.824882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:46.825302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:46.854685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7948c12d-7bc3-4fb2-a157-c723d7143442 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043960 Sep 05 14:43:46.855258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 578/1137] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:47.389225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:47.389864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:47.395824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.396302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.396731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.397415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.397856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.398311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.425618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:47.427802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:47.434154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.434634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.435100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.436304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.436754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.437175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.470271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-81c63c39-2124-4675-a423-31e4be15fa30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048534 Sep 05 14:43:47.470866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 579/1138] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:47.534451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:47.542192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d1c2ce39-42a2-4bcd-87e0-7e59f0b99454 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.157958 Sep 05 14:43:47.542746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 560/1139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:47.763114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:47.765276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:47.771192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.771671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.772105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.772784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.773235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.773654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.802027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b4274016-8fc3-4222-8ac6-f16011b8f551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043067 Sep 05 14:43:47.802567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 580/1140] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:47.866963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:47.869069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:47.875417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.875886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.876310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.876985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:47.878096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:47.878566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:47.906602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-842557c1-ccbc-4886-bbff-bd828010021b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Sep 05 14:43:47.907164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 561/1141] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:48.482315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:48.484526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:48.490977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.491429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.491855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.492526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.492971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.493383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.517345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:48.521857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-330c16ab-1333-4635-8f5e-ebed56670e4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043527 Sep 05 14:43:48.522400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 581/1142] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:48.565107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:48.565711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:48.571674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.572144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.572569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.573243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.573686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.574106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.700989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:48.709272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d23232d0-7c96-421d-870c-819120e519e3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148036 Sep 05 14:43:48.709829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 562/1143] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:48.814545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:48.816630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:48.822635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.823143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.823578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.824255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.824708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.825127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.854002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-675c9989-efe9-4979-933a-da78b49cb3d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044423 Sep 05 14:43:48.854539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 582/1144] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:48.918811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:48.920971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:48.927205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.927675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.928102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.928776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:48.929220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:48.929635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:48.959384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-33c01c94-0036-45fb-8f82-a93932e81662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044539 Sep 05 14:43:48.959923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 563/1145] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:49.534156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:49.536366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:49.542642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.543144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.543574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.544246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.544693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.545108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.573290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd5da963-8081-41c1-bc79-a5cccd450121 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Sep 05 14:43:49.573820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 583/1146] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:49.732586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:49.733770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:49.739744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.740222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.740652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.741330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.741801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.742222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.865705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:49.867877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:49.872062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:49.873732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.874218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.874653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.875370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.875822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.876243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.879887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-76050784-a980-469d-b835-ae98beb82cf8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151178 Sep 05 14:43:49.880441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 564/1147] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:49.906203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-84556ae5-77cd-4422-abd3-710d9b8b5eff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044518 Sep 05 14:43:49.906742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 584/1148] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:49.972240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:49.974669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:49.981021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.981493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.981938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:49.982597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:49.983085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:49.983503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.012129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-63bd73d4-8266-40fe-a503-bef2ffd3902e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044463 Sep 05 14:43:50.014982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 565/1149] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:50.585302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:50.587474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:50.594088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:50.594562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:50.595024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.595707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:50.596149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:50.596564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.625605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cb7a58e7-887a-4c81-b1e1-6adfd2864525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044294 Sep 05 14:43:50.626141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 585/1150] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:50.903240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:50.903771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:50.909691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:50.910162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:50.910587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.911293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:50.911737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:50.912150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.918525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:50.921199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:50.926996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:50.927477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:50.927910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.928592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:50.929049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:50.929517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:50.959818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3fa1caea-7b22-4712-9bd1-822cf90e5253 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045124 Sep 05 14:43:50.960397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 586/1151] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:43:51.025492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:51.027750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:51.034099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:51.034586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:51.035057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:51.035756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:51.036267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:51.036693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:51.041633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:51.050151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2590dde6-fb0a-44a0-8d02-92350df12023 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150518 Sep 05 14:43:51.050710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 566/1152] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:51.067122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dfcdb99d-eb76-47f4-a351-10a0e5edc64f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Sep 05 14:43:51.067688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 587/1153] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:51.637577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:51.640213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:51.646218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:51.646690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:51.647148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:51.647819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:51.648262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:51.648678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:51.677709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-458b9b57-ab92-4ada-91fc-59ce884550fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044056 Sep 05 14:43:51.678252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 567/1154] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:51.972462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:51.974966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:51.981434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:51.981912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:51.982340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:51.983048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:51.983500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:51.983922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.012612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3698a2f8-3bde-4c6d-afef-02e02237de4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044147 Sep 05 14:43:52.013151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 588/1155] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:52.072852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:52.073472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:52.079614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:52.083936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:52.083936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:52.083936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.084258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:52.084354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:52.084354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:52.084354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.087730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:52.088284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:52.088723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.089408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:52.089864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:52.090288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.120339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3df796c-9517-4ed7-9ea6-1416c9f6d517 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044654 Sep 05 14:43:52.121118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 589/1156] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:52.211193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:52.218898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7a81e48-7b12-4093-8ebc-ee238865f0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149925 Sep 05 14:43:52.219452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 568/1157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:52.690197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:52.692419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:52.698383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:52.698907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:52.699350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.700036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:52.700491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:52.700914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:52.729628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e2b46504-0935-45c6-820e-576de1bc6637 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043528 Sep 05 14:43:52.730178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 590/1158] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:53.028067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:53.030820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:53.036713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.037184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.039424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.039424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.039424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.039424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.067525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3d050af1-e6a1-4329-b8da-ee36d292b374 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043322 Sep 05 14:43:53.068089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 569/1159] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:53.133560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:53.135762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:53.142608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.143124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.143557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.144238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.144693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.145112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.174013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57d576dd-2be2-4f5f-b3c2-b45d07571f68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044428 Sep 05 14:43:53.174572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 591/1160] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:53.242154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:53.242770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:53.249850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.250330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.250774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.251486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.251939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.252364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.383370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:53.391688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-95dea99d-00b4-4fd5-95b8-04f180ebe5ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153494 Sep 05 14:43:53.392246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 570/1161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:53.742123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:53.744288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:53.750779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.751293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.751733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.752415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:53.752866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:53.753286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:53.781271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ed332381-31cd-4155-88ec-bd2d535b8122 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043118 Sep 05 14:43:53.781812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 592/1162] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:54.080113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:54.082263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:54.088208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.091376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.091376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.091376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.091376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.091920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.120631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1e1d0204-85ee-48e7-a31e-e215bd41b2bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044508 Sep 05 14:43:54.121182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 571/1163] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:54.187712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:54.189868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:54.196330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.196813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.197249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.197933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.198389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.198830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.227830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c853ccf-3d66-4ca2-9da1-b45966f5a76e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044227 Sep 05 14:43:54.228369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 593/1164] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:54.420548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:54.420548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:54.421500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.421970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.422427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.423131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.423576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.423991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.552113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:54.559743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ec3d5be1-20e7-4bb7-a95e-959c666a5600 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149321 Sep 05 14:43:54.560302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 572/1165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:54.793810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:54.795981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:54.801945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.802426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.802889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.803613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:54.804064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:54.804484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:54.833520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e2811720-fad0-42ca-9422-c99fee72fc33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043728 Sep 05 14:43:54.834062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 594/1166] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:55.133439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:55.135619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:55.141513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.141990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.142419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.143135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.143584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.144003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.172594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49aed0ba-0e08-4a69-88c8-a83ccfbbf4bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043208 Sep 05 14:43:55.173131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 573/1167] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:55.240131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:55.242254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:55.248520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.249570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.250002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.250673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.251145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.251560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.279107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-55bb7582-837f-448c-a5a1-1505ab95ecfb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042942 Sep 05 14:43:55.279641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 595/1168] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:55.582516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:55.583297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:55.589651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.590121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.590546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.591250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.591692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.592108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.721904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:55.729865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-75478407-db5e-4b51-b161-cfe8f368ae59 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151171 Sep 05 14:43:55.730425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 574/1169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:55.846750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:55.849162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:55.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.855990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.856489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.857164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:55.857615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:55.858109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:55.887096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-54a1a765-9b4b-411c-97ea-5bb35f51becb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045595 Sep 05 14:43:55.887647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 596/1170] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:56.185156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:56.187778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:56.193652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.194130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.194561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.195276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.195727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.196146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.199702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:56.225000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb3a77b4-8bad-44c5-9e5b-dd050720f5ed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044089 Sep 05 14:43:56.225537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 575/1171] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:56.291441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:56.293565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:56.299914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.300384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.300808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.301479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.301925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.302340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.331407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-457a2a2e-e8f4-4e16-9028-b1baeed2b670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043905 Sep 05 14:43:56.331943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 597/1172] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:56.754278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:56.754959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:56.761774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.762245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.762670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.763376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.763818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.764259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.889688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:56.897549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a352932a-2e7a-45b8-bfc7-422654954eaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147202 Sep 05 14:43:56.898101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 576/1173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:56.900331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:56.902534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:56.908405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.908882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.909316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.909998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:56.910447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:56.910999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:56.927454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:43:56.940027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bad3ac72-a78e-46e7-be87-d4be6d2950d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043661 Sep 05 14:43:56.941631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 598/1174] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:57.238272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:57.240470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:57.246408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.246920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.247358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.248040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.248496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.248914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.276868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-212554b1-5241-4ad1-ac9b-294511ab6fb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042664 Sep 05 14:43:57.277404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 577/1175] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:57.344263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:57.346400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:57.353475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.353956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.354393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.355102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.355557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.355982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.384567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-28f4e6d2-f7f5-4e2c-a58c-786dae33e09e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044888 Sep 05 14:43:57.385114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 599/1176] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:57.919915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:57.920523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:57.926961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.927438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.927868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.928551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.928997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.929412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.953220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:57.955365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:57.961228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.961707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.962135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.962838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:57.963285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:57.963699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:57.993146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-916fd4c0-596d-4274-9b4d-2887d87fff67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Sep 05 14:43:57.993710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 600/1177] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:43:58.059663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:58.068228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2e3ed7d5-73b2-440b-a7b3-c9bccb7c3a25 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152172 Sep 05 14:43:58.068785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 578/1178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:58.290135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:58.292284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:58.298576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:58.301145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:58.301145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:58.301145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:58.301145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:58.301541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:58.329859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ecd8afb7-ada8-4fc6-8733-4ca01e256173 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043833 Sep 05 14:43:58.330393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 601/1179] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:58.396507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:58.398624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:58.404590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:58.405074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:58.405508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:58.406190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:58.406643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:58.407095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:58.435686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3a7af392-1c7b-47af-9b8f-f955017810eb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043154 Sep 05 14:43:58.436882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 579/1180] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:59.005659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:59.007830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:59.014672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.015196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.015627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.016313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.016766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.017187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.045907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2a8f6aae-26c1-4ff0-bd4b-d1f1ce8e6165 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044245 Sep 05 14:43:59.046454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 602/1181] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:43:59.091028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:59.091644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:59.099120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.099602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.100032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.100772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.101267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.101694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.232006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:43:59.239578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56327b9b-482e-49f9-9818-d871c4935334 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152489 Sep 05 14:43:59.240125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 580/1182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:43:59 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:43:59.342108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:59.344213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:59.350291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.350764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.351230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.351909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.352354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.352781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.381848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f145c8e4-8de1-4ef5-8779-ab185bf00c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043785 Sep 05 14:43:59.382398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 603/1183] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:43:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:43:59.448645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:43:59.450769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:43:59.457409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.457891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.458327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.459044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:43:59.459498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:43:59.459923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:43:59.488233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8364e39a-fcba-4a1d-b42b-c61edc1895f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043573 Sep 05 14:43:59.488769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 581/1184] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:43:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:00.058472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:00.060628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:00.066998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.067476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.068006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.068708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.069161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.069582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.098383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-77c140f4-79a3-4a48-90ca-584e01372274 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043866 Sep 05 14:44:00.099247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 604/1185] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:00.262977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:00.263589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:00.270039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.270526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.270993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.271673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.272122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.272540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.395184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:00.397331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:00.400263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:00.403202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.403693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.404126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.404857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.405850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.406277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.408830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d4b9f1c8-d2d7-492b-a849-eff921d1aba9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149722 Sep 05 14:44:00.409423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 582/1186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:00.434940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-28c77eb3-f0d5-4987-8bc5-cde6a98c5477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044190 Sep 05 14:44:00.435481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 605/1187] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:00.500552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:00.502683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:00.508482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.508957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.509383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.510059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:00.510506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:00.510952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:00.539797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ed5cf607-c0b7-4e74-9a2e-e51ebd1c10f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043146 Sep 05 14:44:00.540257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 583/1188] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:01.111794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:01.113922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:01.120313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.120782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.121209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.121882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.122325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.122768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.151238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a159a03-4b37-4d11-b758-23196f8d5336 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044011 Sep 05 14:44:01.151766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 606/1189] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:01.431927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:01.432591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:01.439593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.440046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.440484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.441177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.441628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.442222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.447328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:01.452462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:01.455858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.456339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.456767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.457452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.457895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.458308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.489034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e208858-a9eb-4863-9b50-ee09673de33a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045612 Sep 05 14:44:01.489608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 607/1190] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:01.552702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:01.555002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:01.561011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.561517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.561956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.562649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:01.563131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:01.563582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:01.576677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:01.584407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c5c81dc9-8008-4137-994f-6028a8d09436 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156433 Sep 05 14:44:01.584970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 584/1191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:01.593733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ee6ca6e-ddd4-4408-886f-caefd81464ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045066 Sep 05 14:44:01.594277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 608/1192] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:02.163824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:02.165983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:02.172234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.172698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.173132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.173824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.174276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.174695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.203546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b6c629fe-64cd-41bc-a65f-461e45ee431a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Sep 05 14:44:02.204088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 585/1193] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:02.502068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:02.504235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:02.510657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.511226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.511671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.512332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.512777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.513192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.542224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-73c04d38-1d0f-426d-bcc1-a53838091544 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044626 Sep 05 14:44:02.542768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 609/1194] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:02.606357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:02.608260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:02.609084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:02.609395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:02.615403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.621919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.622062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.622175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.622302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.622408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.622519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.622615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:02.622706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.622810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:02.622926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.623026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:02.648081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6c0f6096-b983-4030-9b06-66114372be59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045738 Sep 05 14:44:02.648655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 586/1195] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:02.746221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:02.754566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-219f2b2e-1103-48f9-a562-ed1617378fc8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150325 Sep 05 14:44:02.755112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 610/1196] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:44:03.216006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:03.218747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:03.220643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:03.225625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.226104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.226544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.227275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.227732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.228154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.258508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bddab867-d8ab-4f46-bb4c-a0b7f93f539b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046678 Sep 05 14:44:03.259098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 587/1197] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:03.554566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:03.556821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:03.559143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:03.564426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.564900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.567929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.567929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.567929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.567929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.597188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0729fda9-d562-491d-84f4-65d863343b56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046561 Sep 05 14:44:03.597740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 611/1198] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:03.660803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:03.663026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:03.669864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.681580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.681580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.681580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.681580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.682010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.702075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-73d60bd7-1b90-45e4-8f96-d5ab6579c35f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045268 Sep 05 14:44:03.702627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 588/1199] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:03.776483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:03.777089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:03.783534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.784014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.784443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.785124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:03.785572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:03.785988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:03.917031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:03.925950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8028d0b-c56c-469e-ac74-853bf711ac7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153341 Sep 05 14:44:03.926522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 612/1200] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:04.271540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:04.273655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:04.279695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.280166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.281251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.281929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.282374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.282810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.310805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e438b540-9cbc-45f8-a777-788380734998 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043218 Sep 05 14:44:04.311335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 589/1201] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:04.609746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:04.611895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:04.618343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.618841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.619272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.619947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.620389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.620802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.650046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ab10dc8e-c47b-4022-b0c9-154671331f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044317 Sep 05 14:44:04.650571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 613/1202] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:04.713970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:04.716161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:04.722539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.723053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.723485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.724414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.724859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.725274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.753825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b92145e2-6c11-47d1-899f-0b2a5eb7030c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Sep 05 14:44:04.754359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 590/1203] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:04.948615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:04.949149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:04.955145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.955625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.956056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:04.956733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:04.957182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:04.957604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.308940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:05.316803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-03ae6090-e0f1-4110-8ce5-82c6aa6b6632 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.372098 Sep 05 14:44:05.317361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 614/1204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:05.322931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:05.325268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:05.331256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:05.331724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:05.332145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.332933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:05.333376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:05.333790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.358370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:05.363437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06560273-b7d8-4f6e-9ee2-960a4c39d6b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044503 Sep 05 14:44:05.367987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 591/1205] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:05.662715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:05.664870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:05.671210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:05.671682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:05.672107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.672777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:05.673223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:05.673637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.677277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:05.702998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f727e2a6-fb0e-4cdd-9450-0c498a2091df tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043732 Sep 05 14:44:05.703548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 615/1206] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:05.765972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:05.768164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:05.774835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:05.775309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:05.775739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.776413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:05.776859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:05.777275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:05.805975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-00844021-2e87-4a66-a04f-485ddbc6d3c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044455 Sep 05 14:44:05.806503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 592/1207] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:06.340307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:06.340948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:06.347164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.347585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.348012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.348691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.349397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.349809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.376351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:06.378404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:06.384860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.385473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.385971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.386746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.387289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.387839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.418576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dc2b5566-e7d9-4a00-8909-6addd45d70f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046791 Sep 05 14:44:06.419177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 593/1208] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:06.485352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:06.491873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-29adb538-380c-438c-a0df-b7d0e9216439 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155807 Sep 05 14:44:06.492435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 616/1209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:06.715005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:06.717121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:06.723074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.723546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.724260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.724915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.725358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.725772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.754179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-197c790e-07b8-4532-b1e9-5320f0e01624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043183 Sep 05 14:44:06.754715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 594/1210] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:06.818561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:06.820715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:06.827034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.827542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.828514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.829193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:06.829646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:06.830063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:06.858487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ba4cd9a6-abd9-4818-b259-b84b792704ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043812 Sep 05 14:44:06.859007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 617/1211] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:07.431502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:07.433674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:07.440158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.440633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.441066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.441746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.442196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.442619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.470751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e363991e-2751-4915-a513-fc79a18686eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043266 Sep 05 14:44:07.471379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 595/1212] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:07.514960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:07.515570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:07.521458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.521931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.522358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.523061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.523512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.523933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.654040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:07.662184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee0d87e8-15ad-42ce-a5f5-21f3f07f6967 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151085 Sep 05 14:44:07.662748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 618/1213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:07.767052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:07.769168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:07.775041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.775516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.775945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.776614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.777057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.777470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.805848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-da688ffd-0bd5-4b60-97c7-320db9392a45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043304 Sep 05 14:44:07.806375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 596/1214] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:07.870558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:07.872750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:07.879052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.879548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.879981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.880663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:07.881114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:07.881537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:07.910811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-63fcca17-661c-463d-b3eb-e06027a93fcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044200 Sep 05 14:44:07.911358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 619/1215] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:08.483353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:08.485504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:08.491837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.492315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.492740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.493408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.493849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.494263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.522898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5feeb62b-92e3-4688-b258-f3885a9a80f3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Sep 05 14:44:08.523432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 597/1216] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:08.685484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:08.686097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:08.692163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.692639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.693069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.693749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.694200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.694621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.818296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:08.820512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:08.823938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:08.826448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.826977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.827414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.828102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.828549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.828969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.831899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-916e1479-56b8-4e43-916e-2429cf4f6bb8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150276 Sep 05 14:44:08.832543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 620/1217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:08.858016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d23c65da-62f1-4bc1-ada4-c91883f669f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043739 Sep 05 14:44:08.858555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 598/1218] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:08.923702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:08.925861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:08.932130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.932613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.933052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.933736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:08.934185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:08.934609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:08.962572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d3536e01-e87f-45ab-8b25-8f13c9d37701 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043564 Sep 05 14:44:08.963146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 621/1219] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:09.535997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:09.538164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:09.544628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.545103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.545534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.546215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.546664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.547113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.575169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cdb0d875-a882-416a-9f74-31cf6e2840e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043133 Sep 05 14:44:09.575704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 599/1220] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:09.855245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:09.855781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:09.862271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.862744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.863195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.863869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.864316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.864738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.870998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:09.873170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:09.879067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.879552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.879989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.880680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.881127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.881553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.911602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ef08e7d3-2297-4463-bad6-abe55e2abb13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044467 Sep 05 14:44:09.912153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 600/1221] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:09.975711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:09.977846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:09.983704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.984724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.985159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.985839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:09.986287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:09.986741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:09.995960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:10.003774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f8ec1165-71de-410e-b9a8-0dbf6ff09d18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152454 Sep 05 14:44:10.004341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 622/1222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:10.015801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a8e59b9f-b66e-4ef4-89f2-574934464980 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043740 Sep 05 14:44:10.016339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 601/1223] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:10.588194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:10.590320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:10.596255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:10.596725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:10.597153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:10.597825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:10.598269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:10.598685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:10.629253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a195b2df-266f-4a7f-aeb7-4b3ca08a08eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045007 Sep 05 14:44:10.629797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 623/1224] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:10.924360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:10.926402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:10.932986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:10.933463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:10.933891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:10.934574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:10.935053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:10.935479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:10.964167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4c4000da-d100-4749-b87b-2047a66431fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043949 Sep 05 14:44:10.964710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 602/1225] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:11.026327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:11.026965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:11.027896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:11.030445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:11.034011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.034490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.034948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.035628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.036073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.036297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.036489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.036778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.037211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.037896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.038343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.038764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.067359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc6fa65f-e06e-456c-9aba-19466e8686b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 Sep 05 14:44:11.067913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 603/1226] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:11.164988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:11.172599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-36d06dce-b2ae-4e25-8286-9cdf3b917ed7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150100 Sep 05 14:44:11.173153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 624/1227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:11.641589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:11.643759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:11.649647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.650125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.650557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.651273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.651761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.652184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.680428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-244816a3-2a52-48d5-b2e1-d4f01687325f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042817 Sep 05 14:44:11.680971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 604/1228] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:11.977341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:11.979518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:11.986282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.986864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.987306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:11.987997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:11.988454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:11.988885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.017593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2be74121-4c5a-4d4f-b9bb-3cc07f15fb6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044632 Sep 05 14:44:12.018143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 625/1229] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:12.080366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:12.082521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:12.088854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:12.089329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:12.089759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.090439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:12.090918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:12.091332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.121543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-280e83e5-4df1-4dfc-9e11-e6cb82f9d74a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045702 Sep 05 14:44:12.122090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 605/1230] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:12.195572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:12.196184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:12.202457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:12.202993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:12.203525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.204217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:12.204669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:12.205092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.336178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:12.344518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c19c3974-c4a9-4320-ad07-0a8a7289240d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152818 Sep 05 14:44:12.345073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 626/1231] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:12.693395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:12.695547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:12.701566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:12.702037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:12.702598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.703799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:12.704242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:12.704657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:12.732817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-87da0a9b-c09a-4924-963e-66716070ad7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Sep 05 14:44:12.733354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 606/1232] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:13.029132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:13.031897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:13.037971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.038440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.038899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.039572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.040019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.040441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.069813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7531a0ec-2fa1-42f8-864c-77d0de8b9ade tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044610 Sep 05 14:44:13.070420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 627/1233] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:13.133708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:13.135926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:13.142851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.143344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.143782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.144474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.144930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.145356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.174709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06aee249-8f2e-42e9-993f-be5a01124df8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Sep 05 14:44:13.175285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 607/1234] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:13.367979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:13.368516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:13.374757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.375261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.375691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.376399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.376848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.377263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.572736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:13.580941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8132eced-bf79-4835-9142-05af5a4fccbb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.216891 Sep 05 14:44:13.581493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 628/1235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:13.745412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:13.747583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:13.753953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.754424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.754884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.755570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:13.756016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:13.756434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:13.773205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:13.785197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-708b6492-674a-4044-8550-fc991b12f90e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Sep 05 14:44:13.785755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 608/1236] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:14.082599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:14.085045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:14.091089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.091578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.092016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.092712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.093173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.093598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.124165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-62fde6c8-a6d7-479e-9f7e-520878ac237b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045572 Sep 05 14:44:14.266330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 629/1237] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:14.266503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:14.266503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:14.266503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.266503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.267305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.267305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.267305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.267305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.267661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1119d088-73ae-4ebd-b67f-5d98399a6a53 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044505 Sep 05 14:44:14.267661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 609/1238] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:14.604188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:14.605262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:14.611788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.612266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.612691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.613370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.613815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.614233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.743636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:14.751831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2f98da26-08c1-49cb-9021-a39d912823b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151556 Sep 05 14:44:14.752387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 630/1239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:14.797934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:14.800111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:14.806425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.806941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.807376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.808060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:14.808513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:14.808934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:14.837442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c59cb8af-f6a7-4bdd-8f34-2175ba5449bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Sep 05 14:44:14.837983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 610/1240] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:15.139030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:15.141162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:15.147050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.147526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.147954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.148630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.149076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.149492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.175837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:15.180406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fc3e7078-5766-4c31-bfc2-51273242479f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045404 Sep 05 14:44:15.180939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 631/1241] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:15.240481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:15.242662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:15.248678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.249164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.249605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.250292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.250748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.251200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.280242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a45b9f92-2c26-450f-ad84-3ea21da1138b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Sep 05 14:44:15.280896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 611/1242] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:15.775272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:15.775887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:15.782910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.783388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.783818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.784491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.784936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.785355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.850531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:15.852814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:15.859373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.859859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.860292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.860982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:15.861434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:15.862382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:15.891043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-69d1b8b5-80e0-4d1a-b244-2cef80b7da41 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044641 Sep 05 14:44:15.891604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 612/1243] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:15.916065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:15.924299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-283a0acf-b55e-47ed-a42f-b59ff05113cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153315 Sep 05 14:44:15.924856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 632/1244] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:16.193346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:16.195514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:16.201574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.202046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.202518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.203230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.203675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.204090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.233139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b3b41916-157b-450c-9d95-9eadc7039f00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043834 Sep 05 14:44:16.234169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 613/1245] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:16.293236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:16.295400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:16.301688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.302158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.302581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.303298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.303747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.304169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.332886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cb2e524d-57e4-4e0d-a96a-ebade30c4f28 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043751 Sep 05 14:44:16.333434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 633/1246] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:16.903530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:16.905714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:16.912460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.912939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.913375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.914124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.914577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.915030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.944249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5628e108-5a95-4b92-bd97-1a8e547e286e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044742 Sep 05 14:44:16.944794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 614/1247] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:16.947302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:16.947919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:16.953924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.954402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.954859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:16.955545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:16.955998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:16.956419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.082622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:17.090278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3e14392-26b6-494a-8ac5-53915e9cbbb2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147076 Sep 05 14:44:17.090877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 634/1248] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:44:17.245682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:17.247828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:17.254138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:17.254608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:17.255069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.255744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:17.256188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:17.256604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.285104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-41736374-9875-4046-87d6-a4bf1a02f6fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043440 Sep 05 14:44:17.285634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 615/1249] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:17.345167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:17.347400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:17.353926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:17.354405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:17.354867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.355557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:17.356009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:17.356463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.385135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d1b94224-e18c-4c85-bce5-301f3b22ba16 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044055 Sep 05 14:44:17.385679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 635/1250] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:17.956710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:17.958872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:17.965377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:17.965854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:17.966283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.967019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:17.967466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:17.967884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:17.997528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6c63c294-fa3a-44f5-a42c-e0d43014b207 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044755 Sep 05 14:44:17.998075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 616/1251] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:18.113409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:18.114045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:18.119974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:18.120446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:18.120870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:18.121538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:18.121982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:18.122418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:18.255436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:18.263034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7bce4a92-59d4-424a-ae0c-4a50fb12ee61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154076 Sep 05 14:44:18.263592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 636/1252] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:18.297694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:18.299906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:18.305875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:18.306347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:18.306781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:18.307485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:18.307966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:18.308408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:18.338388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eb40ad91-e32c-4793-974f-dc0ffd7ddb0b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044732 Sep 05 14:44:18.339102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 617/1253] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:18.397220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:18.399377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:18.405760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:18.406232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:18.406660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:18.407370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:18.407821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:18.408300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:18.436830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-edee5a84-a849-44bc-872a-f76c261aec4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 Sep 05 14:44:18.437372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 637/1254] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:19.009733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:19.011978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:19.019087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.019566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.020000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.020685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.021133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.021553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.050220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4d90eb0f-ad97-4a95-9bd1-994b338dbcbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044485 Sep 05 14:44:19.050779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 618/1255] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:19.286057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:19.286580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:19.292561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.293040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.293469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.294208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.294664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.295114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.352006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:19.354191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:19.360512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.360988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.361412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.362099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.362543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.362995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.393560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eb521d5b-42e4-4a66-b19b-d0818856ae71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045838 Sep 05 14:44:19.394124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 619/1256] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:19.428149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:19.435895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3afc05c8-5a25-4910-96de-e888744c31e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153795 Sep 05 14:44:19.436455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 638/1257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:19.448964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:19.451221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:19.457235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.457711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.458141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.458835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:19.459284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:19.459701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:19.489932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-40b11436-a0dd-423d-a7a0-acb37f844e2c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044852 Sep 05 14:44:19.490475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 620/1258] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:20.062718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:20.064938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:20.070867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.071357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.071791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.072477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.076725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.076725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.103812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2e30b264-96f3-435c-888a-1636af75a66e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045014 Sep 05 14:44:20.104591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 639/1259] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:20.406261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:20.408389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:20.414933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.415409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.415839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.416519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.416964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.417383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.446039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2b8d971f-c756-4038-80d6-feb4d92b805c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044005 Sep 05 14:44:20.446586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 621/1260] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:20.459774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:20.460382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:20.466778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.467281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.467710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.468448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.468894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.469309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.502436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:20.504675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:20.510701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.511219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.511657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.512355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:20.512806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:20.513226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:20.543077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e1283efb-dfe1-4b81-ad8e-0163ffe97ee2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045167 Sep 05 14:44:20.543629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 622/1261] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:20.598121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:20.606005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-841a7d10-392d-4836-a1f7-646aeec4d80c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150102 Sep 05 14:44:20.606557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 640/1262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:21.116215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:21.118377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:21.124389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.124867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.125300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.125982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.126432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.126899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.157930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9bd26e68-4973-447e-a08a-fba728d99e7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045627 Sep 05 14:44:21.158482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 623/1263] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:21.458198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:21.460308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:21.466371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.466877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.467311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.467997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.469120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.469542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.498033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fbabf21b-1efd-4311-a7b3-7c279e63c4a3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043919 Sep 05 14:44:21.498578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 641/1264] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:21.556008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:21.558142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:21.564453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.564921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.565344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.566020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.566465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.566905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.595904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-071e3b33-a68f-4252-88cd-66b0f53210d6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Sep 05 14:44:21.596428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 624/1265] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:21.629143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:21.629753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:21.635642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.636124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.636559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.637238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:21.637692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:21.638115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:21.771718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:21.779713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-42a9c8cc-f64f-4baf-bfc1-5b58454028ea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154452 Sep 05 14:44:21.780316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 642/1266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:22.170429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:22.173123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:22.179053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.179526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.179954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.180632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.181081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.181525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.185027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:22.209975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6d025be6-dd92-4e25-84ec-8dab2b1b735d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043518 Sep 05 14:44:22.210516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 625/1267] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:22.510733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:22.512924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:22.519507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.519992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.520422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.521108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.521669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.522093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.552290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-007d25b1-8754-457b-b1ed-3cd53700f9bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045518 Sep 05 14:44:22.552850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 643/1268] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:22.608072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:22.612077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:22.618944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.619425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.619860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.620549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.621000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.621532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.653197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-33b500e1-014a-49b4-af4e-dbba6cfd3dc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049417 Sep 05 14:44:22.653751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 626/1269] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:22.802782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:22.803348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:22.809380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.809856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.810290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.811008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:22.811459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:22.811882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:22.940843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:22.948537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a9fb131-bc06-4af9-bb8d-9b0188723c24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149666 Sep 05 14:44:22.954002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 644/1270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:23.222100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:23.224619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:23.230605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.232550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.232550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.232550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.232888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.233147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.261555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8b7ed5b4-4714-4b24-bfb8-a295f48f379e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043991 Sep 05 14:44:23.262091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 627/1271] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:23.565236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:23.567449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:23.573860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.574330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.574754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.575552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.575928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.576347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.606648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a022d826-2a74-48b4-876c-5f5fc9a49845 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045416 Sep 05 14:44:23.607240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 645/1272] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:23.665483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:23.667674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:23.673905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.674378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.674832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.675553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.675996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.676416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.706154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c7d1ef6c-c427-4e78-87f6-754769db8300 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044510 Sep 05 14:44:23.706704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 628/1273] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:23.971216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:23.972107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:23.978597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.979141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.979589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:23.980269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:23.980748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:23.981167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.113338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:24.120940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eaf3e50f-44a6-4d1a-828e-e277d6d40722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153570 Sep 05 14:44:24.121492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 646/1274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:24.275402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:24.277746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:24.283657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:24.284139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:24.284571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.285239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:24.285676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:24.286117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.314996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2e9240d2-b129-4d00-bbc2-bbdc235a5d92 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045094 Sep 05 14:44:24.315550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 629/1275] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:24.619422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:24.621544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:24.628726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:24.629248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:24.629705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.630379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:24.630852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:24.631268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.660014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7c6c95c-49ef-45b5-97bf-031143938289 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044592 Sep 05 14:44:24.660558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 647/1276] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:24.718862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:24.721038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:24.727395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:24.727909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:24.728346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.729032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:24.729483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:24.729905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:24.759010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5a709055-f4a3-424f-b285-accbd153523b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044546 Sep 05 14:44:24.759556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 630/1277] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:25.145107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:25.145734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:25.151598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.152066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.152491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.153162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.153606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.154021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.171950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:25.281520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:25.289110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57a7e843-6806-42e6-a33b-6c88b49e764c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147945 Sep 05 14:44:25.289665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 648/1278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:25.327388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:25.329525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:25.335373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.335843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.336274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.336951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.337394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.337808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.366312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-42d452a6-6428-4780-9063-efc171dcfddf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Sep 05 14:44:25.366779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 631/1279] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:25.772668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:25.774917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:25.782120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.782604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.783115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.783882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.784363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.784864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.789047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:25.791266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:25.797187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.797668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.798100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.798806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:25.799260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:25.799682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:25.813925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1c5daf18-a5b4-449f-b287-66b94e18fead tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045985 Sep 05 14:44:25.814477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 632/1280] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:25.828909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-538f6cf3-974b-45e6-98dc-0e5eff231102 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.161234 Sep 05 14:44:25.829453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 649/1281] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:26.312821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:26.313429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:26.319345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.319816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.320245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.320919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.321367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.321783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.377936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:26.380215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:26.386117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.386598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.387063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.387765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.388211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.388630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.417977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-642e3667-4ef7-4b1b-ba00-6eabcb9d67dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044399 Sep 05 14:44:26.418529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 650/1282] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:26.501419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:26.509021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-563ea3f7-69e1-42f3-be32-b7b37f031657 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.200622 Sep 05 14:44:26.509576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 633/1283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:26.826136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:26.828836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:26.835241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.835718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.836150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.836831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.837279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.837697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.841170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:26.843315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:26.850540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.851057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.851483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.852167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:26.852607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:26.853021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:26.868155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3928aa0f-4a61-49ca-b3fe-322830273bd9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045741 Sep 05 14:44:26.868637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 651/1284] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:26.883243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1c646036-c7c4-497d-aae0-64a7677d56ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045956 Sep 05 14:44:26.883783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 634/1285] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:27.430585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:27.432761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:27.438633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.439143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.439571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.440245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.440690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.441104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.470071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3d9b99ae-856b-469a-8598-9222a9360063 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043752 Sep 05 14:44:27.470608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 652/1286] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:27.533086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:27.533690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:27.539644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.540120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.540551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.541225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.541681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.542086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.669434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:27.677110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-db5007d5-693b-4529-bdae-a185c1b2b16c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148552 Sep 05 14:44:27.677665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 635/1287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:27.880431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:27.882606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:27.888883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.889360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.889792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.891141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.891591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.892012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.895732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:27.897876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:27.904289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.904761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.905189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.905905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:27.906355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:27.906770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:27.921096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4874ab9a-737b-477f-96ca-8386195e46e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Sep 05 14:44:27.921712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 653/1288] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:27.935199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8370bb9a-18f2-457a-ad65-b2cb3879f3b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043432 Sep 05 14:44:27.935731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 636/1289] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:28.482628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:28.484774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:28.490661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.491172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.491604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.492282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.492733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.493153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.522517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-64ce268f-8ddd-4ced-bd9d-7d4f1f34f819 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043918 Sep 05 14:44:28.523085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 654/1290] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:28.699620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:28.700226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:28.702089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:28.706714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.707224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.707654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.708328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.708771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.709187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.842093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:28.850518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-572f39a1-52de-40d9-950a-5f9811c98850 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154787 Sep 05 14:44:28.851107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 637/1291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:28.933528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:28.935698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:28.942607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.943208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.943644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.944326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.944776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.945198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.948229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:28.950367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:28.956637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.957109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.957536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.958215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:28.958658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:28.959116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:28.975089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-be8abf79-046e-4458-8b5e-6de8d95081cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045067 Sep 05 14:44:28.975661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 655/1292] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:28.991234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f35aea34-3b1e-4bf0-89ef-5f00eef272bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047062 Sep 05 14:44:28.991776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 638/1293] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:29.534967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:29.537117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:29.543020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:29.543502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:29.543936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:29.544619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:29.545070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:29.545491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:29.573115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4a24c53-8cd4-4d49-aaab-591706d423bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042729 Sep 05 14:44:29.573649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 656/1294] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:29.872602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:29.873139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:29.879865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:29.880350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:29.880785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:29.881477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:29.881925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:29.882344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.018529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:30.027667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bdcdd303-4719-4987-a85b-82f360ca92f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.159044 Sep 05 14:44:30.028451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 639/1295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:30.033544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:30.035675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:30.043984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:30.044461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:30.044892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.045582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:30.046030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:30.046509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.077191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-98d1e8c5-fde6-4c58-b4a3-c1d3f4a7dc99 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047922 Sep 05 14:44:30.077806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 640/1296] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:30.082751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:30.087043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:30.095171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:30.095171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:30.095171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.095171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:30.095612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:30.096008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.129234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d330fe13-fff6-4734-a94e-de2bb532b753 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.145508 Sep 05 14:44:30.129999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 657/1297] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:30.585600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:30.588017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:30.593937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:30.594412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:30.594873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.595557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:30.596002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:30.596420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:30.621979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:30.627261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b1ec1879-c8a3-4bda-887c-e1ca53101245 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045789 Sep 05 14:44:30.627822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 641/1298] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:31.051433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:31.052035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:31.058454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.058971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.059399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.060085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.060534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.060941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.090930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:31.093133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:31.102571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.103087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.103556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.104289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.104740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.105165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.136060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-44f2204b-d515-48e3-b65d-0eb1123424d1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050494 Sep 05 14:44:31.136937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 642/1299] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:31.141232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:31.143319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:31.148999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.149482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.149917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.150608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.151088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.151511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.181135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-63d26664-c29d-483c-931f-a91ae02dcc94 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Sep 05 14:44:31.181687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 643/1300] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:31.200938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:31.208514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-446b361a-631d-4915-8227-852cfae167f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.160840 Sep 05 14:44:31.209082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 658/1301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:31.640060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:31.642870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:31.648733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.649211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.649649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.650333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:31.650800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:31.651224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:31.680885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c20692c7-8c11-4f30-bde0-8a387cc5fb2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044705 Sep 05 14:44:31.681369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 644/1302] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:32.148749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:32.151035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:32.158120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.158595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.159057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.159739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.160185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.160602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.189584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3d44b349-fe02-414b-a652-820c8482d796 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044838 Sep 05 14:44:32.190128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 659/1303] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:32.193791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:32.195989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:32.202287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.203454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.203896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.204580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.205031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.205453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.231151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:32.231754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:32.234225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e0f63216-211d-4e01-a8ce-fdd2e45a9d10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044332 Sep 05 14:44:32.234771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 645/1304] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:32.237522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.238002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.238430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.239133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.239579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.239998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.372135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:32.380188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-16366deb-7a6b-4b9a-88df-bf7290db7476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152777 Sep 05 14:44:32.380746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 660/1305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:32.692712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:32.694905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:32.700810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.701287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.701714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.702389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:32.703371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:32.703785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:32.733772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09885aff-ae4b-4928-afae-923e1234bdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044979 Sep 05 14:44:32.734359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 646/1306] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:33.201826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:33.204647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:33.207040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:33.211677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.212160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.212597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.213280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.213730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.214152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.244079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-89c74a5a-3a5b-4c8c-8914-6224acb2990f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046197 Sep 05 14:44:33.244709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 661/1307] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:33.247674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:33.251717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:33.256947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.257427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.257863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.258560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.259037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.259462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.289562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55113d77-a3c3-4f7e-8ac8-0086fef50948 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046537 Sep 05 14:44:33.290146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 647/1308] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:33.403529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:33.404068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:33.409990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.410471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.410941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.411624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.412073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.412491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.539920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:33.548074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-686aba6a-6c82-4df4-8fd9-220e26c730c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148448 Sep 05 14:44:33.549002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 662/1309] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:33.745623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:33.747858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:33.754343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.754832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.755254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.755983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:33.756427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:33.756845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:33.785224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-93b69c37-d90a-434a-a451-d029d1e2ab9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043575 Sep 05 14:44:33.785758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 648/1310] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:34.256870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:34.259017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:34.265465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.265932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.266417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.267119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.267566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.268014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.296036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4b7d7956-ae31-4f2c-a82f-cb55b95cdf77 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043197 Sep 05 14:44:34.297157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 663/1311] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:34.302184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:34.304338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:34.310589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.311087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.311515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.312863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.313347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.313764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.341858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d3bbd299-7156-49b0-bbe8-348699d9d389 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 Sep 05 14:44:34.342390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 649/1312] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:34.572192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:34.572796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:34.579286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.579756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.580181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.580852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.581296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.581712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.712643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:34.720775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9009b6a7-a460-4a22-854e-131ff30d6c1b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152447 Sep 05 14:44:34.721329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 664/1313] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:34.797564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:34.799779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:34.805620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.806102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.806539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.807247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:34.807698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:34.808118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:34.836456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fd095775-fd67-426a-8d5b-8f1006d9dba3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042828 Sep 05 14:44:34.837005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 650/1314] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:35.309173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:35.311466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:35.317799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.318274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.318703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.319411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.319898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.320319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.323956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:35.350853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9463b8ed-2091-4b2d-a7e5-e087467efa59 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045594 Sep 05 14:44:35.351332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 665/1315] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:35.354687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:35.357227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:35.364544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.375816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.375816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.375816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.375816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.376205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.396663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a6757bb3-f664-4809-aff6-446d8797bb25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046228 Sep 05 14:44:35.397217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 651/1316] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:35.744276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:35.744889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:35.751324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.751798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.752254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.752930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.753378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.753796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.849628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:35.851820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:35.857681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.858152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.858578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.859295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:35.859743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:35.860159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:35.881127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:35.888530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ca76460-1e6c-42fd-9d22-dea72326bfb7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043089 Sep 05 14:44:35.888693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ef312f86-6ff6-4f4d-9a5c-3a09076993c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148267 Sep 05 14:44:35.889086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 652/1317] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:35.889499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 666/1318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:36.364383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:36.366537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:36.373400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.373872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.375089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.375777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.376226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.376643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.407576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-27ca075b-4ace-41cb-a072-fe8684c15322 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048862 Sep 05 14:44:36.408616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 653/1319] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:36.408781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:36.410459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:36.416893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.417372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.417805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.418490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.418972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.419395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.449130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-322285fa-9732-43ea-b753-20fbff97dc4c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Sep 05 14:44:36.449681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 667/1320] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:36.901386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:36.903563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:36.910012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.910493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.910962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.911652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.912105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.912525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.913212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:36.913853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:36.919754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.920233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.920666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.921413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:36.922389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:36.922823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:36.941675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-164992f6-d9cf-45da-98b8-c1e16b621bbb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044465 Sep 05 14:44:36.942230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 654/1321] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:37.053617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:37.061208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bc7fcae5-76fb-400a-980b-7347951be3c9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152546 Sep 05 14:44:37.061766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 668/1322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:44:37.420127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:37.422308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:37.428778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:37.429262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:37.429685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:37.430365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:37.430840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:37.431265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:37.460478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:37.460990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-654eb25e-2443-4ddd-8039-631c8d8f5a23 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Sep 05 14:44:37.461126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 655/1323] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:37.462781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:37.469100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:37.469576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:37.470008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:37.470684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:37.471160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:37.471616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:37.500541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d40e79d1-c91a-46cd-807f-6acebf6925f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Sep 05 14:44:37.501069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 669/1324] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:37.953777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:37.955951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:37.962004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:37.962494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:37.962960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:37.963656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:37.964108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:37.964526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:37.994408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5b05e914-b80d-443c-8cbe-e0d485dde6e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Sep 05 14:44:37.994991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 656/1325] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:38.083503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:38.084108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:38.090066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:38.090547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:38.091012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:38.091703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:38.092155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:38.092576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:38.219560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:38.227442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ac2d159-8bd3-44c9-937b-90a5614179b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147817 Sep 05 14:44:38.228003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 670/1326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:38 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:38.473386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:38.475774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:38.482025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:38.482497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:38.482958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:38.483632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:38.484077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:38.484490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:38.512919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:38.513469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f2ace13c-33d6-4379-892c-f716c73ab2bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044001 Sep 05 14:44:38.513790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 657/1327] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:38.515694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:38.521978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:38.522455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:38.522928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:38.523617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:38.524067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:38.524486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:38.553314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-26427aba-2094-4543-96c3-c7ea884a6ff2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044460 Sep 05 14:44:38.553857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 671/1328] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:39.007143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:39.009292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:39.015305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.015812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.016249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.016932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.017386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.017809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.034241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:39.046341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4afc660c-4cf4-4b5c-95db-7c25d7ccdd7d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043123 Sep 05 14:44:39.047535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 658/1329] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:39.250093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:39.250694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:39.256560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.257032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.257507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.258133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.258576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.259023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.387078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:39.394759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0d43f5e8-a911-4102-9bc6-43443bd186f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148560 Sep 05 14:44:39.395325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 672/1330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:39.526750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:39.528884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:39.535301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.535777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.536209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.536894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.537342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.537765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.566084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:39.567778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dd5d2f77-422c-4e30-8750-bc5fa3402417 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045407 Sep 05 14:44:39.568503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:39.568646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 659/1331] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:39.574889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.575368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.575801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.576488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:39.576943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:39.577369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:39.605996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-160f4e22-c186-42f2-85c0-eda38721608a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044423 Sep 05 14:44:39.606542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 673/1332] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:40.059024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:40.061148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:40.067674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.068146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.068572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.069245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.069689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.070104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.098740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09dd143e-a614-4558-b627-7eac32e7eabf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Sep 05 14:44:40.099315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 660/1333] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:40.417587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:40.418115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:40.424179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.424660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.425091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.425822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.426280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.426703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.556786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:40.565086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-15cef792-c9f9-450a-b920-8f71c0bd0e90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151499 Sep 05 14:44:40.565645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 674/1334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:40.581005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:40.583201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:40.589404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.589875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.590302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.591010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.591454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.591871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.618277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:40.620507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:40.620718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-37ab88de-bf39-42ee-9b03-10dcf18433c4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044239 Sep 05 14:44:40.621422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 661/1335] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:40.627603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.628451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.628921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.629615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:40.630065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:40.630487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:40.660131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-21c41344-3d23-4acd-b63b-4ba3640f1ccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045798 Sep 05 14:44:40.660671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 675/1336] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:41.111867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:41.114072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:41.119966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.120443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.120886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.121566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.122015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.122435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.151130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4d2b2c10-933c-4477-9fb0-3362103bdf87 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043829 Sep 05 14:44:41.151672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 662/1337] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:41.588943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:41.589551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:41.595847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.596326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.596758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.597437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.597887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.598308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.633622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:41.635826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:41.642198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.642677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.643143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.643841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.644290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.644714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.673999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-81775013-d177-4cf2-b63b-568c2c2a9d54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044256 Sep 05 14:44:41.674563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 663/1338] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:41.679105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:41.681243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:41.687671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.688153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.688583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.689272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:41.689720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:41.690146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:41.719077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0651553f-87d5-4a6c-80a1-d0a997746839 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043413 Sep 05 14:44:41.719647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 664/1339] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:41.728881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:41.737109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d432eefd-cfb8-459c-b391-2c8c94382883 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152079 Sep 05 14:44:41.739066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 676/1340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:42.163199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:42.165315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:42.171201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.172273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.172703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.173377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.173820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.174234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.203124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8ea481e2-d7ff-4613-b2d2-b84bf5085a40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Sep 05 14:44:42.203674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 665/1341] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:42.685794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:42.687985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:42.694380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.694886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.695318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.695989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.696433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.696847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.726778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7813dbe-4ca6-40d1-bb96-6650b840d714 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045059 Sep 05 14:44:42.727338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 677/1342] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:42.731617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:42.734394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:42.740801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.741281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.741714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.742397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.742875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.743302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.759656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:42.760430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:42.766884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.767359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.767784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.768458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:42.768909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:42.769323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:42.773214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9bf728ba-077c-4420-abf1-8067808bc3d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045667 Sep 05 14:44:42.773942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 666/1343] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:42.898760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:42.906934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f766be4c-695e-4ce8-a8f6-08a180d878f5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151061 Sep 05 14:44:42.907498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 678/1344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:44:43.215658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:43.217777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:43.223655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.224123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.224809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.225484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.225925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.226339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.256033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bc696337-881f-42ce-acd8-5ea656f96385 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044390 Sep 05 14:44:43.257624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 667/1345] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:43.739864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:43.742025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:43.749102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.749581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.750017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.750693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.751165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.751585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.780036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1cb025fd-7f3b-4578-96a8-de6e2eb80919 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044160 Sep 05 14:44:43.780657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 679/1346] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:43.786118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:43.788307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:43.794373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.794885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.795322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.796003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.796450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.796874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.824681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-30f83453-1575-4c40-a622-c32dac09ece6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043172 Sep 05 14:44:43.825211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 668/1347] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:43.930600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:43.931230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:43.937575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.938048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.938475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:43.939174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:43.939622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:43.940036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.069954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:44.078090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd96d2b6-d5b0-4984-96ea-ccd6e7235b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151181 Sep 05 14:44:44.078663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 680/1348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:44.267830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:44.269920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:44.275816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:44.276288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:44.276713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.277389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:44.277832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:44.278247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.308086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a231c376-6a39-4ecc-83bd-9f324ff5f7c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Sep 05 14:44:44.308626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 669/1349] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:44.793200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:44.795351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:44.801808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:44.802282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:44.802707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.803408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:44.803854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:44.804270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.828561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:44.833630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-533f27d0-f29d-484f-a5d6-1e13a45a1752 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044449 Sep 05 14:44:44.834169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 681/1350] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:44.837537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:44.844492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:44.846470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:44.846983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:44.847419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.848109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:44.848560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:44.848985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:44.877939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aa8b9963-29bb-4836-bd13-5e8ca593504a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Sep 05 14:44:44.878406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 670/1351] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:45.101493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:45.102091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:45.108434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.108906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.109328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.110000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.110446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.111529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.237725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:45.245398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-205074d5-0e28-498f-abab-e5bbeb4de158 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148025 Sep 05 14:44:45.245949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 682/1352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:45 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:45.320310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:45.322536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:45.328537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.329013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.329961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.330647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.331191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.331618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.361319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a39f0f71-afad-4b81-9190-ac166af7370b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Sep 05 14:44:45.361859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 671/1353] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:45.846171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:45.848348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:45.855083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.855559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.855995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.856674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.857125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.857550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.886864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-76d0ded4-863d-4b38-8a79-1d18ceff5299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044652 Sep 05 14:44:45.887415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 683/1354] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:45.889789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:45.892671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:45.899087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.899562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.899995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.900680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:45.901129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:45.901549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:45.929436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-838e5488-331c-4bdf-9235-d9db6c01ca47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Sep 05 14:44:45.929979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 672/1355] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:46.267268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:46.267875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:46.273829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.274308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.274751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.275435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.275879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.276291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.373549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:46.375754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:46.381683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.382166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.382601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.383322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.383772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.384191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.409367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:46.413690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-52034d79-7b17-4f06-beff-7e7c5bd1bb6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044086 Sep 05 14:44:46.414258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 673/1356] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:46.417098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7389abcf-ce28-40c4-88b4-b5dde9a8f52c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153802 Sep 05 14:44:46.417651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 684/1357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:46.899403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:46.901489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:46.908830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.909309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.909743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.910433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.910916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.911347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.939766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f54e25c6-1626-4d33-b9c0-44600d338f1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044396 Sep 05 14:44:46.940316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 674/1358] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:46.941656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:46.943969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:46.949799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.950278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.950713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.951432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:46.951886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:46.952343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:46.982049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-901a5174-0e0a-439d-8064-682f175ead7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044479 Sep 05 14:44:46.982773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 685/1359] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:47.426224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:47.428428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:47.434524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:47.435043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:47.435496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:47.436184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:47.436635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:47.437052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:47.440619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:47.441233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:47.441503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:47.447571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:47.448060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:47.448492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:47.449183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:47.449641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:47.450064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:47.467445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae8d277c-69f6-4754-ac22-16dba7a8d0b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045241 Sep 05 14:44:47.468090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 675/1360] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:47.579151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:47.586747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-16dda8dc-ed6c-4402-8010-dbe0aaa0589c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150452 Sep 05 14:44:47.587344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 686/1361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:47.952424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:47.955046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:47.961466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:47.972089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:47.972089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:47.972089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:47.972089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:47.972495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:47.994404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:47.996567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:47.996715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f66b97bf-9c9d-488c-8b20-66c6c7acf0ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048623 Sep 05 14:44:47.997224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 676/1362] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:48.002729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:48.003242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:48.003679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:48.004367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:48.004819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:48.005247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:48.034488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-132f9f95-f3c7-45e4-a182-7348c8d79f7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043620 Sep 05 14:44:48.035077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 687/1363] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:48.479983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:48.482241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:48.488696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:48.489115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:48.489542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:48.490246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:48.490691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:48.491134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:48.519322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96c5ac65-e44f-4dcd-bbf4-b39323fa09da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043391 Sep 05 14:44:48.519855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 677/1364] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:48.609734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:48.610331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:48.617662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:48.618141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:48.619005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:48.619350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:48.619800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:48.620217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:48.755391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:48.763061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-44e22c25-585c-4c90-83bf-e7259b297798 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.157151 Sep 05 14:44:48.769610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 688/1365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:49.009291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:49.011395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:49.017920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.018985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.019417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.020095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.020540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.020958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.046708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:49.048872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:49.050368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e605a6ed-56d4-42b2-9b24-f2737bce1e6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045125 Sep 05 14:44:49.050941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 678/1366] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:49.054778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.055353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.055784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.056475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.056927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.057352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.086816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-98e4578d-f128-405f-a159-f51620b27a18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044042 Sep 05 14:44:49.087381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 689/1367] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:49.531666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:49.533820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:49.539637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.540116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.540541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.541213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.541663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.542077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.570042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-058ce6ae-86db-419b-b6ac-15be76aacdce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042309 Sep 05 14:44:49.570575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 679/1368] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:49.785429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:49.786031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:49.792375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.792855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.793283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.793966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:49.794413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:49.794854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:49.922018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:49.930527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e44d4bed-3cdf-4a12-9c7b-97f0ab06a452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149035 Sep 05 14:44:49.931116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 690/1369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:50.062435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:50.064666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:50.071973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.072465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.072902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.073597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.074050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.074476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.100291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:50.102514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:50.104712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e27cb1cc-e0c3-47a9-b22d-9e6ad7ddeb31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046263 Sep 05 14:44:50.105279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 680/1370] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:50.108435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.108910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.109342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.110021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.110469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.110911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.139952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4021b23d-75c2-42c1-8a87-dd391fc09127 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Sep 05 14:44:50.140499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 691/1371] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:50.582838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:50.584971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:50.590846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.591324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.591754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.592428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.592876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.593292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.622041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-440a1b0d-802b-4518-9da5-df2814b92b0c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043704 Sep 05 14:44:50.622597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 681/1372] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:50.953638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:50.954172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:50.961159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.961629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.962109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:50.962816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:50.963282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:50.963697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.094143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:51.102405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-adaeac14-2fec-4e31-8dbe-05a34d93b3b8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152595 Sep 05 14:44:51.103018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 692/1373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:51.117593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:51.119854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:51.126109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:51.126585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:51.127059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.128280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:51.128756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:51.129159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.152174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:51.154332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:51.158816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83169c29-b0a4-42fe-b378-a5ed5056342a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045116 Sep 05 14:44:51.159291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 682/1374] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:51.160210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:51.160686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:51.161115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.161796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:51.162239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:51.162654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.192012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-84830b73-7ff6-4f19-8a28-73cf22b910c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043781 Sep 05 14:44:51.192722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 693/1375] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:51.634442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:51.636650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:51.642820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:51.643348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:51.643771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.644444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:51.644887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:51.645300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:51.673921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-acddf2a9-45f6-4e1a-b098-330bc3ce543d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043567 Sep 05 14:44:51.675150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 683/1376] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:52.125131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:52.125743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:52.132280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.132792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.133226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.134080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.134599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.135057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.171691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:52.173813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:52.180280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.180768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.181197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.181892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.182336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.182851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.213721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a0ad93f4-a980-4f16-a34b-b6073220f87a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045797 Sep 05 14:44:52.214288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 684/1377] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:52.218923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:52.221042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:52.227819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.228299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.228733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.229420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.229872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.230303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.258656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1686bab6-a96b-452c-94f3-d1399d228c84 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043363 Sep 05 14:44:52.259243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 685/1378] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:52.268522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:52.276204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b6942a0d-e1e5-4e7e-a345-e6678978b0a8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154943 Sep 05 14:44:52.276750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 694/1379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:52.687061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:52.689184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:52.695712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.696185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.696611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.697285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:52.697727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:52.698143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:52.726017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c15f9414-9fce-4eff-bf69-893746c19a6f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043061 Sep 05 14:44:52.726560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 686/1380] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:53.227092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:53.229265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:53.231237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:44:53.231380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:44:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments (ip 10.222.0.15) !!! Sep 05 14:44:53.238812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.239284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.239720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.240406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.240860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.241279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.270904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ede6f51-1abe-425a-8653-707e727fa4c5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048001 Sep 05 14:44:53.271551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 695/1381] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:53.271746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:53.273896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:53.276786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:53.281433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.281907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.282336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.283054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.283507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.284659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.300728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:53.301334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:53.307165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.307647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.308076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.308760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.309213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.309634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.314307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80cf47c8-f6e0-4b9d-8adf-cfb4c88003c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046844 Sep 05 14:44:53.314886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 687/1382] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:53.439678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:53.447318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-df31b221-1c01-4782-8086-fcbb2441d198 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151054 Sep 05 14:44:53.447896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 696/1383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:44:53.738138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:53.740311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:53.746612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.747124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.747555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.748231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:53.748678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:53.749096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:53.777339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d6c36416-12d1-40d7-bbd0-ed077832bb0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043217 Sep 05 14:44:53.777870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 688/1384] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:54.283517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:54.285597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:54.291917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.292390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.292813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.293488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.293933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.294350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.323768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06cd3d31-be9d-478d-8f5e-29acbd2987b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044291 Sep 05 14:44:54.324361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 697/1385] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:44:54.326772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:54.328975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:54.335315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.335793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.336226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.336911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.337363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.337787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.366867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5f259af7-a080-4d1c-9810-8f4fb8dccc43 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Sep 05 14:44:54.367412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 689/1386] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:54.471204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:54.471835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:54.478077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.478546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.479002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.479671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.480115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.480530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.499533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:54.614942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:54.623153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8cfab523-c58c-430c-95e8-2d75da49cfd9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156109 Sep 05 14:44:54.623707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 698/1387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:54.789454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:54.791644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:54.797531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.798007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.798439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.799148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:54.800171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:54.800589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:54.828413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8a0c9c6e-c7f3-4851-b7a9-7a4ccde3e17b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042872 Sep 05 14:44:54.828884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 690/1388] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:55.337008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:55.339162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:55.345630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.346154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.346535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.347255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.347706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.348124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.376847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-02c06c29-d8b7-4a9a-abc2-a3b198a3a3c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043871 Sep 05 14:44:55.377901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 699/1389] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:55.379054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:55.381211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:55.387710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.388190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.388628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.389321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.389777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.390201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.414947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:44:55.419485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-51108f61-a6bd-4057-985c-3538e439a48e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045116 Sep 05 14:44:55.458597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 691/1390] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:55.645991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:55.646525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:55.652377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.652852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.653277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.653950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.654402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.654843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.781804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:55.789416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d690b659-da4e-475e-8cf5-00c17be72b6c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148042 Sep 05 14:44:55.790009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 700/1391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:55.839815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:55.841963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:55.848266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.848748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.849188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.850149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:55.850605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:55.851071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:55.880012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-062245cf-bdb9-44b5-b5d7-56ad8c2d6968 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044113 Sep 05 14:44:55.880547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 692/1392] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:56.389821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:56.391916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:56.398749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.399248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.399670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.400345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.400789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.401205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.430631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-452e87a0-939d-4508-98d6-404cd151534e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044876 Sep 05 14:44:56.431272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 701/1393] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:56.469226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:56.472038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:56.478621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.479129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.479560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.480233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.480680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.481096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.509119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-472c13c4-8c46-43f8-9428-83bd22633069 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Sep 05 14:44:56.509660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 693/1394] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:56.812582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:56.813186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:56.819645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.820126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.820554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.821224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.821670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.822082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.892044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:56.894946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:56.900886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.901362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.901790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.902470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:56.902943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:56.903364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:56.931543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7dccbaba-44e5-4680-9b90-b57f579c208d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043370 Sep 05 14:44:56.932102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 694/1395] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:44:56.953547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:56.961721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-35780d1d-1b00-4e57-ac9b-23ad11720610 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153098 Sep 05 14:44:56.962276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 702/1396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:57.443904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:57.446039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:57.452027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.452552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.452986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.453667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.454117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.454539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.483803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-727a71ac-b0b1-483b-8eb9-eb1899de0418 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Sep 05 14:44:57.484413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 695/1397] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:57.521289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:57.523489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:57.529850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.530331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.530763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.531467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.531919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.532338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.561244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a351cfa1-00fd-4417-93a4-e33ceacfd216 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Sep 05 14:44:57.561781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 703/1398] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:57.943823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:57.946043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:57.952285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.952755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.953184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.953857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.954307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.954778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.984769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:57.985368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:57.985498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-565213da-6c57-4d31-8029-22e758b19796 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045475 Sep 05 14:44:57.986005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 696/1399] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:57.991238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.991710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.992136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:57.992807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:57.993250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:57.993661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:58.123366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:58.131134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cfa6b775-ba5a-4952-aaaf-a63aaa41b591 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150094 Sep 05 14:44:58.131681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 704/1400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:44:58.497521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:58.499699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:58.506734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:58.507242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:58.507673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:58.508358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:58.508808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:58.509228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:58.538411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a05aa61a-a193-47f7-918e-495f76c9f245 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045054 Sep 05 14:44:58.538978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 697/1401] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:58.574133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:58.576356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:58.583243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:58.583716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:58.584141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:58.584816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:58.585263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:58.585679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:58.614636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-59fd92cb-712e-41ce-9b11-39e300c72b93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044528 Sep 05 14:44:58.615210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 705/1402] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:58.997629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:58.999819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:59.006160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.006631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.007089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.007761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.008206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.008618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.036381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c19d6bd7-b5cc-4742-91be-af974a859b84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042766 Sep 05 14:44:59.036916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 698/1403] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:44:59.154745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:59.155388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:59.162124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.162636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.163118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.163837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.164289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.164709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.290724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:44:59.298339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-45fd21f5-b998-48a7-b393-6e54219fd60e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147486 Sep 05 14:44:59.298921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 706/1404] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:44:59 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:44:59.551915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:59.554022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:59.560370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.560845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.561277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.561963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.562411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.562855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.591653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-70412f15-4351-466d-a36f-ab8a3b777875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043818 Sep 05 14:44:59.592189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 699/1405] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:44:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:44:59.626854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:44:59.629055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:44:59.635373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.635852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.636283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.636967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:44:59.637415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:44:59.637834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:44:59.667099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0242a873-2afe-454f-8408-60eeccf11642 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044171 Sep 05 14:44:59.667643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 707/1406] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:44:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:00.048884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:00.051105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:00.057091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.057570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.058006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.058691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.059171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.059599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.089299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d42242ce-6bb3-4011-9931-98d22d96a88d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044466 Sep 05 14:45:00.089863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 700/1407] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:00.321380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:00.321915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:00.327841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.328322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.328755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.329433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.329882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.330335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.461067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:00.468612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7963adfb-a05d-40e2-a173-90d0f17883bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151131 Sep 05 14:45:00.469160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 708/1408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:00.605073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:00.607153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:00.614117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.614575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.615035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.615721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.616170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.616590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.645091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5f28629c-1241-440c-ab4d-c8b76e2c3970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044133 Sep 05 14:45:00.645643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 701/1409] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:00.680202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:00.682336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:00.688592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.689065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.689497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.690203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:00.690647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:00.691112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:00.719067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ca7aad2-7709-463f-8db6-10a3605373a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Sep 05 14:45:00.719605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 709/1410] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:01.102466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:01.104644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:01.110508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.111038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.111485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.112165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.112612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.113032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.141601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3988754b-7cf7-4a25-92fc-e6e273f59799 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043385 Sep 05 14:45:01.142143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 702/1411] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:01.491266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:01.491877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:01.497808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.498290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.498720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.499429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.499881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.500301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.627457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:01.635777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c4a3316-508d-477b-9e92-25cc9e8230e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148373 Sep 05 14:45:01.636377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 710/1412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:01.657167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:01.659441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:01.666414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.666932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.667359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.668063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.668509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.668924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.702529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c0181292-ea3d-4ceb-976e-f1fad16b5f21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049539 Sep 05 14:45:01.703135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 703/1413] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:01.732624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:01.734774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:01.737086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:01.742301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.742935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.743254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.743940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:01.744391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:01.744811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:01.773997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4be1cb9f-c24a-4ff5-9403-c66174d20826 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045543 Sep 05 14:45:01.774537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 711/1414] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:02.153667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:02.155890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:02.162267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.162742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.163200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.163882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.164328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.164748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.193673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a077fbc0-979a-4d76-a5fb-5efd127310ed tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043989 Sep 05 14:45:02.194216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 704/1415] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:02.716003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:02.717171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:02.717781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:02.718293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:02.725222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.725453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.725688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.725941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.726112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.726377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.726814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.727105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.727269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.727565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.727677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.727996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.758510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6d59e803-8e55-49fa-9bcc-67f6b910dce8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047019 Sep 05 14:45:02.759451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 712/1416] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:02.786382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:02.788680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:02.794598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.795210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.795651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.796352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:02.796830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:02.797280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:02.827401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f3140abd-9ac3-4bae-9da4-c64e0e46e75a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045720 Sep 05 14:45:02.827969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 713/1417] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:02.862086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:02.869789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96c8bc79-3f86-4bae-8d1f-953df73c9edb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156432 Sep 05 14:45:02.870372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 705/1418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:03.205652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:03.207829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:03.213824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.214300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.214726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.215424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.215871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.216316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.245227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-04f8618f-c61a-4276-ab8e-7188b5fa1a3c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Sep 05 14:45:03.245770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 714/1419] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:03.771061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:03.773222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:03.779654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.780129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.780577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.781255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.781700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.782117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.811831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4ba72916-cc1d-47c3-844b-d9c2cc6ff8e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044855 Sep 05 14:45:03.812365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 706/1420] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:03.840324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:03.842443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:03.849325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.849797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.850480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.851182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.851632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.852049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.855565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:03.880552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-895b5fe4-f3af-45ef-a4c0-18561c7e869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044124 Sep 05 14:45:03.881085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 715/1421] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:03.892754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:03.893359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:03.899720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.900134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.900560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:03.901232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:03.901675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:03.902086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.029948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:04.038170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bf26fb00-7b10-4fb9-a340-bd5dbcdf6c86 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149140 Sep 05 14:45:04.038723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 707/1422] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:04.258087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:04.260248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:04.266574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:04.267085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:04.267517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.268192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:04.268636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:04.269054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.297187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4c8d481b-8588-453f-a2ae-5a17b8b8b623 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043716 Sep 05 14:45:04.297711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 716/1423] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:04.824109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:04.826288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:04.833494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:04.833978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:04.834411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.835132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:04.835636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:04.836087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.853256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:04.865659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8bf8eb58-81f3-4889-8e13-75480df3a40b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046108 Sep 05 14:45:04.866313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 708/1424] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:04.892899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:04.895004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:04.901854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:04.902332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:04.902764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.903468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:04.903920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:04.904337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:04.933255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-34cd8161-19b9-4f29-85b8-4c97f0957b88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044358 Sep 05 14:45:04.933800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 717/1425] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:05.060762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:05.061366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:05.068189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.068670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.069098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.069773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.070243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.070659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.202440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:05.210324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7467e129-f163-4682-be5d-ee34a3988d0f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153425 Sep 05 14:45:05.214558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 709/1426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:05 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:05.309514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:05.311703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:05.317562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.318036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.318499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.319211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.319664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.320085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.347987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f9ff7b6-1abd-4cd0-890f-16b2e2c38ee1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042479 Sep 05 14:45:05.349021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 718/1427] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:05.877794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:05.880464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:05.886907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.887383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.887812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.888493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.888938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.889357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.918260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d30a7a48-c2e6-4f90-8651-6b4310227e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044530 Sep 05 14:45:05.918810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 710/1428] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:05.945851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:05.948021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:05.954376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.954890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.955326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.956009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:05.956462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:05.956885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:05.986501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8aec7410-8350-4354-afc3-157586db3cdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044998 Sep 05 14:45:05.987086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 719/1429] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:06.233397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:06.234003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:06.240509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:06.240985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:06.241412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:06.242093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:06.242538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:06.242988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:06.361124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:06.363469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:06.370073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:06.372456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:06.372456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:06.372456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:06.372456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:06.372881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:06.380324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:06.389784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7e982a29-75cc-4477-9f8b-d9c776810e6d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.160068 Sep 05 14:45:06.390451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 711/1430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:06.408820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48d165f6-2e4c-4dcc-988f-bbf0a58503cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051739 Sep 05 14:45:06.409394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 720/1431] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:06.931436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:06.933728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:06.940473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:06.940944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:06.941372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:06.942185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:06.942630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:06.943078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:06.972210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-37447e57-a274-46a9-855c-33c6d61404e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045110 Sep 05 14:45:06.972749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 712/1432] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:06.998800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:07.000980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:07.007400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.007880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.008312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.008993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.009441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.009863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.039088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3a8a8ba4-8831-4797-973c-d86d58c20c76 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044201 Sep 05 14:45:07.039640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 721/1433] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:07.413263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:07.413862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:07.419759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.420035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:07.420232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.420660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.421337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.421784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.422164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:07.422293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.428076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.428550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.428986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.429665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.430122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.430540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.460666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-594564b4-a524-40cd-8ef7-921f123503fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044478 Sep 05 14:45:07.461229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 722/1434] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:07.551833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:07.559562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fdeb3e01-b38a-4121-a359-3ce3c0e3ed2b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150200 Sep 05 14:45:07.560123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 713/1435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:07.985621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:07.987781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:07.993865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.994347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.994773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:07.995473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:07.995918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:07.996334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.025767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ebbc0e8-876f-4f34-a4f6-5dcbe33f4ec8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044095 Sep 05 14:45:08.026379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 723/1436] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:08.051292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:08.053441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:08.059926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:08.060402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:08.060835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.061519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:08.061968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:08.062390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.092581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-72340d49-bb4b-4fee-8e3f-a757fc373944 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045179 Sep 05 14:45:08.093147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 714/1437] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:08.473081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:08.475501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:08.481335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:08.481807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:08.482244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.482951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:08.483397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:08.483813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.512589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b6b025b-8759-4c9c-b826-bbfdebacda40 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043495 Sep 05 14:45:08.513119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 724/1438] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:08.582908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:08.583510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:08.589333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:08.589806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:08.590232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.590938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:08.591381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:08.591796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:08.722602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:08.730733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-05f0151e-c8a1-4a71-b379-ade4005714fd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151564 Sep 05 14:45:08.731317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 715/1439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:09.038732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:09.040810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:09.047119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.047587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.048015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.048687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.049130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.049543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.080930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1aa20bcd-ecc0-460b-82d2-a7656a50ba0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046674 Sep 05 14:45:09.081483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 725/1440] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:09.105699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:09.107925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:09.114928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.115408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.115840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.116523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.116971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.117415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.146408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e0ee4696-9285-4a55-b29b-d30361b98d2d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044764 Sep 05 14:45:09.146981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 716/1441] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:09.525609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:09.527767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:09.533629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.534101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.534526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.535224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.535673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.536089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.563947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1d14fe18-d730-477f-89f7-11c3eb7acde0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042285 Sep 05 14:45:09.564480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 726/1442] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:09.754234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:09.755405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:09.761414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.761888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.762318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.763030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:09.763483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:09.763902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:09.889606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:09.897994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8369a029-a617-42bf-8327-eb8fd025ce3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147583 Sep 05 14:45:09.898587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 717/1443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:10.093541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:10.095712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:10.102288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.102768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.103231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.103919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.104374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.104795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.134214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd73f726-a62a-468a-8919-e8ee227a73cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044817 Sep 05 14:45:10.134755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 727/1444] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:10.157831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:10.160207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:10.166537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.167048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.167476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.168328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.168781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.169198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.199157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-59e03dc7-1851-4aed-a296-40810666dc85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045265 Sep 05 14:45:10.199694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 718/1445] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:10.576667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:10.578818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:10.584781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.585261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.585693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.586374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.586844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.587269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.616931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1562911e-225c-49e2-bc02-646695c007c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044197 Sep 05 14:45:10.617481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 728/1446] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:10.920917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:10.921464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:10.927461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.927945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.928397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:10.929068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:10.929518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:10.929941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.060046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:11.068314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fe6c4edf-2e6f-4f6d-894c-ca16c3e7782a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151302 Sep 05 14:45:11.068891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 719/1447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:11.147702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:11.149890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:11.156475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:11.156957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:11.157392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.158080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:11.158539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:11.159005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.187738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-345d88ba-ce08-49a1-9e99-eb020a58e551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044765 Sep 05 14:45:11.188211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 729/1448] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:11.212084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:11.214211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:11.220524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:11.220995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:11.221424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.222099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:11.222579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:11.223023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.251322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-161a9b06-e292-48fb-90e6-60f69e1168c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043856 Sep 05 14:45:11.251850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 720/1449] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:11.629358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:11.632145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:11.638041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:11.638520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:11.638999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.639681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:11.640134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:11.640556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:11.668663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-62cf1e55-347b-4bb2-8af8-fc9cc5cca7fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043195 Sep 05 14:45:11.669210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 730/1450] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:12.092038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:12.092645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:12.098669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.099172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.099597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.100534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.100974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.101387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.200572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:12.202722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:12.209012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.209488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.209920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.210603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.211077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.211496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.229937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:12.236165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:12.237809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c11d9dda-ac60-4def-8e08-90ff92a67476 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149714 Sep 05 14:45:12.238616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 721/1451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:12.241260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f1f1e9a2-67c4-4e96-9150-17979c3ccadf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044646 Sep 05 14:45:12.241809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 731/1452] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:12.263310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:12.265456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:12.271291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.271785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.272215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.272897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.273339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.273755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.302441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-daf471f4-bf99-4af1-9c4e-e118ffe8990b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042967 Sep 05 14:45:12.303069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 722/1453] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:12.680958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:12.683136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:12.689408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.689892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.690326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.691037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:12.691496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:12.691917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:12.719909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-04628e79-c4b4-4676-b211-537d4caa4a0e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043523 Sep 05 14:45:12.720459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 732/1454] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:13.257118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:13.259336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:13.261863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:13.262481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:13.265858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.266334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.266760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.267476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.267921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.268338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.268847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.269338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.269767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.270457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.270937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.272005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.297810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53161e09-5828-4caf-b3c7-9408467bc177 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045245 Sep 05 14:45:13.298369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 723/1455] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:13.314515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:13.316688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:13.323233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.323703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.324131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.324808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.325254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.325693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.361573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3e5a900d-c34b-4a27-98f0-e32a6e516e68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044743 Sep 05 14:45:13.361573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 724/1456] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:13.403449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:13.411256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5f161476-7347-453f-9884-0f8013ecf8e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153387 Sep 05 14:45:13.411824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 733/1457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:13.732811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:13.735009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:13.741531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.742000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.742425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.743125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:13.743570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:13.743986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:13.747577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:13.772763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-307ecd56-b280-473e-adf0-51e850a52299 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043861 Sep 05 14:45:13.773388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 725/1458] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:14.310638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:14.312791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:14.319216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.319695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.320128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.320819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.321274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.321697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.350541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3dc554be-facd-42a6-aa63-24daa94022de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043157 Sep 05 14:45:14.351045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 734/1459] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:14.372399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:14.374529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:14.380697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.381176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.381607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.382291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.382738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.383185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.411460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c2402cea-51cf-4571-8301-b6b0c676881d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043387 Sep 05 14:45:14.412605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 726/1460] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:14.433854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:14.434463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:14.440415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.440892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.441513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.442198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.442647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.443106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.571829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:14.579399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6125a3af-94e7-4c40-be59-1eba8da3512e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149408 Sep 05 14:45:14.579956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 735/1461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:14.784865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:14.787026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:14.793348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.793828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.794238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.794959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:14.795402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:14.795814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:14.824569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7c9b8995-51fc-4d8d-8c18-edaea9c56f4a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043678 Sep 05 14:45:14.825111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 727/1462] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:15.363321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:15.365515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:15.372131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.372603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.373033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.373706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.374154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.374598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.403965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fa0caaa8-314e-4fa8-a541-d732ea6a54c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044837 Sep 05 14:45:15.404503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 736/1463] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:15.424254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:15.426408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:15.432406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.432892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.433333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.434025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.434482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.434937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.463981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-79c1d435-143b-409d-bdb2-e1f116f80891 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043694 Sep 05 14:45:15.464536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 728/1464] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:15.602922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:15.603516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:15.609330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.609804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.610228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.610928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.611377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.611791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.739693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:15.747276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c59597ff-0b40-4296-97b3-e3f8509043aa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148579 Sep 05 14:45:15.747836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 737/1465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:15.837374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:15.839545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:15.845856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.846336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.846770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.847481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:15.847935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:15.848389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:15.877483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3ea42051-0625-4b76-9557-c0ac38003a78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044672 Sep 05 14:45:15.878029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 729/1466] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:16.416940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:16.419096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:16.425114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.425623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.426054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.426732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.427207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.428349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.457011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b20426bf-a6c5-4aca-a708-3e22e78cb70b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044764 Sep 05 14:45:16.457551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 738/1467] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:16.477020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:16.479166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:16.485070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.485542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.485973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.486653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.487130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.487548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.517276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cdb28942-76d2-4d09-8dd5-652860a74b8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044958 Sep 05 14:45:16.517807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 730/1468] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:16.771696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:16.772352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:16.778205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.778687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.779150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.779830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.780284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.780701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.889520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:16.891715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:16.898392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.899609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.900043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.900732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:16.901179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:16.901592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:16.911368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:16.919959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-33fe06d8-9992-413d-bc2f-f78a248c178f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152692 Sep 05 14:45:16.920529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 739/1469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:16.930987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d7708a8-20c1-4b1b-bb23-3cc0ae9b894b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045339 Sep 05 14:45:16.931535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 731/1470] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:17.469720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:17.471911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:17.478472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.478985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.479416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.480086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.480532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.480949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.510085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a499ad1-19be-4cb1-b375-b1c83056de93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044477 Sep 05 14:45:17.510616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 740/1471] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:17.529494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:17.531680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:17.537662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.538132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.538561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.539273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.539724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.540148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.569436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-21dd2634-bee6-473c-b523-d906fed5b113 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043993 Sep 05 14:45:17.569974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 732/1472] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:17.942966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:17.943203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:17.943529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:17.945318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:17.949445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.950001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.950439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.951159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.951611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.951788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.952031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.952269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.952728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.953422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:17.953952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:17.954380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:17.983455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d752d080-fd68-4575-a636-81b1e5df29fb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044345 Sep 05 14:45:17.984227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 733/1473] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:18.081364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:18.089013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d683b43b-744a-4f07-a1c4-e191945e62a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150030 Sep 05 14:45:18.089573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 741/1474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:18.522358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:18.524489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:18.530404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:18.530994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:18.531331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:18.532016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:18.532471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:18.532914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:18.561272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dd9df7a7-4371-4ece-8cb0-4334170a48d8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043657 Sep 05 14:45:18.561827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 734/1475] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:18.581348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:18.583526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:18.590469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:18.590990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:18.591429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:18.592115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:18.592567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:18.592991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:18.621893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a9ba714a-daa1-4d52-ad89-c10590a75a60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044409 Sep 05 14:45:18.622619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 742/1476] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:18.995956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:18.998148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:19.004503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.004999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.005424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.006143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.006631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.007075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.035444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e443cc6d-37f3-4936-9322-982f809f17f5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043408 Sep 05 14:45:19.035986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 735/1477] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:19.111994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:19.112607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:19.118683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.119212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.119648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.120334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.120790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.121239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.249804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:19.257979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a337a7bf-abb4-463c-bfc1-483b54d5e4f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149985 Sep 05 14:45:19.258541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 743/1478] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:19.574416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:19.576491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:19.582364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.582870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.583303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.584602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.585050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.585472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.613736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cefcbde9-a5ce-4eb7-95d7-6fd83329e2af tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043456 Sep 05 14:45:19.614278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 736/1479] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:19.634077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:19.636238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:19.642512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.643034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.643448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.644124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:19.644566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:19.644984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:19.672994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8c57f89-30dc-4a23-b71d-8d12cd26b51a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043526 Sep 05 14:45:19.673602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 744/1480] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:20.048332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:20.050506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:20.053472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:20.058112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.058590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.059056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.059739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.060194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.060609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.088869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-212764fe-c97c-4682-9b58-4b2f6a3c9713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044477 Sep 05 14:45:20.089420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 737/1481] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:20.282189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:20.282907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:20.289342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.289819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.290280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.290989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.291439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.291859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.420006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:20.428390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8a972420-84b8-455c-96fc-092814005819 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149938 Sep 05 14:45:20.428959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 745/1482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:20.626801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:20.628919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:20.635287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.635765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.636521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.636870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.637322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.637741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.667283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7560ff38-581a-4cbf-a994-672c40b3e138 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Sep 05 14:45:20.667823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 738/1483] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:20.685645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:20.687841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:20.694139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.694616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.695109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.695790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:20.696241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:20.696661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:20.726747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-31f88096-e074-4b80-a947-cf91b3c02f07 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045081 Sep 05 14:45:20.727497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 746/1484] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:21.101605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:21.103806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:21.110152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.110625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.111288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.111978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.112433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.112851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.142248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0a32eef-1fe2-4f46-83df-b2d470d723b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044696 Sep 05 14:45:21.142812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 739/1485] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:21.451606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:21.452139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:21.457952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.458429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.458897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.459579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.460027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.460443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.588013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:21.595684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-50fe02b3-5f1a-4c3a-a903-af90840607a5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148067 Sep 05 14:45:21.596240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 747/1486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:21.679721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:21.681888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:21.687859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.688336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.688770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.689448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.689896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.690313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.720054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c4c10b07-6dad-4134-b0d5-e34f1b3400b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044328 Sep 05 14:45:21.720604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 740/1487] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:21.739159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:21.741307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:21.747801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.748277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.748712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.749393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:21.749844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:21.750265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:21.767087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:21.780749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9233aec-3adb-47cb-995a-1d592d3226e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045542 Sep 05 14:45:21.781303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 748/1488] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:22.155052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:22.157191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:22.163645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.164129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.164564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.165250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.165704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.166150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.190368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:22.195679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d89abfd2-77e1-4e57-abd5-0ecfcb62ddbf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 05 14:45:22.196225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 741/1489] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:22.619467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:22.620072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:22.626099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.626582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.627060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.627745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.628196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.628617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.732757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:22.734903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:22.741907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.742496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.742975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.743663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.744108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.744528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.761108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:22.768967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b70b187-bf56-48dd-8044-5fbad06b8f30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154317 Sep 05 14:45:22.769533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 749/1490] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:22.775348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-490f48a9-6be3-4d30-a6a9-1d485a4e2a74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047266 Sep 05 14:45:22.775903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 742/1491] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:22.793699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:22.795855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:22.801728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.802205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.802638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.803355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:22.803806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:22.804226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:22.832445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5983e58a-441c-4df6-9fff-ead58d9c493f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042660 Sep 05 14:45:22.832979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 750/1492] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:23.208086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:23.210207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:23.216588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.217089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.217520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.218198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.218698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.219140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.248441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bdba4853-f044-4da0-8282-51e1eecf99ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044361 Sep 05 14:45:23.248978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 743/1493] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:23.788073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:23.790324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:23.792558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:23.793165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:23.796814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.797350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.797752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.798412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.799079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.799228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.799508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.799649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.800253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.801110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.801562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.801984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.831299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-81aa5ee3-ca16-4298-97dd-a38f8a6f1ffb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047109 Sep 05 14:45:23.831877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 751/1494] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:23.844934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:23.847261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:23.853507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.854059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.854559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.855348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:23.855803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:23.856224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:23.885577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-29a1d693-06de-43f5-ae48-8657007e30dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044315 Sep 05 14:45:23.886052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 752/1495] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:24.006321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:24.014231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-62f11f42-0665-4b83-88fd-94bd4f0e31eb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.225420 Sep 05 14:45:24.014878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 744/1496] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:24.261359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:24.263567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:24.269468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:24.269949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:24.270378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:24.271135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:24.271591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:24.272012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:24.300547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f644c2b-4186-4217-bb66-20d54b798ae9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043185 Sep 05 14:45:24.301087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 753/1497] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:24.844738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:24.846923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:24.854372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:24.854869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:24.855303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:24.855978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:24.856423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:24.856844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:24.886476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7df345fa-dd1c-4051-92a1-b799b2fe5268 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045720 Sep 05 14:45:24.887061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 745/1498] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:24.897962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:24.900090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:24.906423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:24.906931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:24.907361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:24.908033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:24.908479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:24.908898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:24.938179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ce75983-afc3-4e1d-a689-526a6651ec2b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Sep 05 14:45:24.938716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 754/1499] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:25.038424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:25.039078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:25.044943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.045412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.045834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.046509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.046988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.047408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.175589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:25.183766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4ad621ab-2b0c-4628-b48d-ebd1eccf04cd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149864 Sep 05 14:45:25.184326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 746/1500] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:25.313377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:25.315551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:25.321357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.321839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.322272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.323011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.323462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.323883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.352390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-55ebd665-1f0f-48e9-a07c-2c6390443320 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042929 Sep 05 14:45:25.352936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 755/1501] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:25.899077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:25.901252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:25.907791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.908267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.908698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.909375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.909821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.910259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.939324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cbf84a1b-3c5e-42ed-b3cd-e6ab0fed277e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044267 Sep 05 14:45:25.939860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 747/1502] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:25.949968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:25.952141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:25.958535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.959040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.959473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.960184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:25.960632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:25.961048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:25.990354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e392313-899a-4267-a767-a51ff2eae2da tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Sep 05 14:45:25.990911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 756/1503] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:26.208168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:26.208364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:26.214231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:26.214707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:26.215182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:26.215866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:26.216322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:26.216740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:26.344658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:26.353224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80b08e3d-88de-408d-bb7c-f58a3aedaac2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149478 Sep 05 14:45:26.353786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 748/1504] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:26.364427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:26.366609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:26.372574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:26.373052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:26.373521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:26.374203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:26.374652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:26.375101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:26.404135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ad33270-ee62-4515-8113-8f5b2c311efd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043817 Sep 05 14:45:26.404672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 757/1505] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:26.951949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:26.954078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:26.961304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:26.961786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:26.962219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:26.962976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:26.963428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:26.963847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:26.993332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e1335c58-6274-4074-b3d4-01ea7eb7bc6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045456 Sep 05 14:45:26.993881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 749/1506] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:27.003142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:27.005359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:27.012099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:27.012572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:27.013016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:27.013674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:27.014120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:27.014537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:27.043771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f3315438-fc32-4567-86e4-444aac3ef5ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044565 Sep 05 14:45:27.044312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 758/1507] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:27.375515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:27.376124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:27.382650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:27.383165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:27.383599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:27.384287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:27.384741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:27.385185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:27.415797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:27.418066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:27.424070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:27.424630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:27.425069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:27.425764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:27.426215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:27.426634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:27.456801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-af2bbea5-e809-401c-a584-6634e70f7f65 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044891 Sep 05 14:45:27.461720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 759/1508] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:27.518545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:27.526334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3c14ef66-79d4-4b71-860e-d261b038aed8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154821 Sep 05 14:45:27.526917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 750/1509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:28.007844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:28.010024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:28.017413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.018017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.018489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.019414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.019908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.020379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.055658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-44017213-e294-44bd-9c1c-eba8df8f4ba3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052860 Sep 05 14:45:28.056303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 760/1510] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:28.056582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:28.058935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:28.065710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.066184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.066616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.067347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.067844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.068403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.098619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-11fc5c44-ad7e-4467-91ec-02cac374a1ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046232 Sep 05 14:45:28.099211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 751/1511] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:28.471729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:28.473887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:28.476046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:28.480620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.481078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.481507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.482181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.482625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.483067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.511462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-980f0b68-19c0-497c-9c7e-b129dba00529 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Sep 05 14:45:28.512014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 761/1512] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:28.548660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:28.549257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:28.555661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.556133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.556554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.557224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:28.557667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:28.558081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:28.685525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:28.693190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-688be6b8-8175-4922-ad8a-57d24aa82980 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148310 Sep 05 14:45:28.693742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 752/1513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:29.069176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:29.071372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:29.077678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.078160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.078592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.079309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.079760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.080183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.109672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b26294a-f334-4f78-bcff-02ccd315136b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044858 Sep 05 14:45:29.110231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 762/1514] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:29.112562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:29.114733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:29.121942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.122464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.122936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.123630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.124089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.124513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.152734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5576f3b5-b997-4280-81b4-3e8c1a64077a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044761 Sep 05 14:45:29.153282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 753/1515] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:29.524760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:29.527001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:29.533189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.533672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.534102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.534817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.535265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.535688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.565620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-72430e04-49d9-4179-a17e-5cf0306f01da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045323 Sep 05 14:45:29.566196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 763/1516] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:29.717220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:29.717864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:29.723869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.724350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.724780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.725719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:29.726172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:29.726593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:29.856660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:29.864338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c3adb8ca-c4ce-4527-bcbd-9f1a993e15c6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151033 Sep 05 14:45:29.864901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 754/1517] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:30.122536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:30.124696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:30.131115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.131589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.132017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.133359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.133802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.134218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.164364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f30a6bc5-c404-4660-a8f7-9d3920625dd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045761 Sep 05 14:45:30.164608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:30.165049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 764/1518] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:30.167768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:30.174216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.174703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.175416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.176137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.176882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.177331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.208273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53b37d63-cc01-4123-9599-80d105124abc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047632 Sep 05 14:45:30.209023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 755/1519] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:30.577689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:30.579922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:30.586412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.586947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.587382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.588058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.588507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.588929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.592571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:30.616955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3eba59b-f067-4997-99cb-c17b75156a57 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043312 Sep 05 14:45:30.617499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 765/1520] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:30.888033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:30.888692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:30.894619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.895139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.895574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:30.896254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:30.896705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:30.897124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.025377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:31.033052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-38fcece2-2b62-452d-ab58-f37b2cd383bc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149001 Sep 05 14:45:31.033611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 756/1521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:31.177002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:31.179628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:31.186473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:31.186987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:31.187427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.188110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:31.188558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:31.188979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.218066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9bf51ec5-b539-427b-90b2-d29104d50f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045163 Sep 05 14:45:31.218616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 766/1522] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:31.220784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:31.223050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:31.230073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:31.230539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:31.231000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.231791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:31.232240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:31.232656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.262469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-03c8f216-46a9-4a40-9523-d2c233885baa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045616 Sep 05 14:45:31.263755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 757/1523] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:31.629447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:31.631875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:31.638915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:31.639392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:31.639822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.640500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:31.640944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:31.641591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:31.670449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e55c0f91-5983-4665-a25a-7768c09df92b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045000 Sep 05 14:45:31.671014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 767/1524] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:32.056321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:32.056953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:32.062862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.063340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.063771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.064451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.064897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.065316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.083395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:32.195801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:32.203739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0fc50a4-8d8c-4869-b3e9-f86faf2f2697 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151925 Sep 05 14:45:32.204292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 758/1525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:32.230187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:32.232342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:32.238555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.239055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.239487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.240160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.240607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.241022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.269564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-25d63ac8-fc45-4f94-a680-5c5c4743d0a1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044078 Sep 05 14:45:32.270103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 768/1526] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:32.275016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:32.277150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:32.283507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.283983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.284418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.285103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.285554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.285975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.315186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e33f51dc-f21c-4d7e-8479-ed9b93eb0cf5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044038 Sep 05 14:45:32.315722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 759/1527] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:32.682711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:32.684919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:32.691005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.691508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.691945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.692654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:32.693107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:32.693596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:32.722672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c6b410cd-b113-4a23-a229-3f09daeb2c4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044554 Sep 05 14:45:32.723412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 769/1528] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:33.225779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:33.226381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:33.232564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.233020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.233449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.234131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.234580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.235113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.281942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:33.284128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:33.290465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.293871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.293871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.293871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.293871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.294284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.323060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-44a230b9-1376-47bb-8e15-2ada61976705 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044916 Sep 05 14:45:33.323635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 770/1529] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:33.328345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:33.330492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:33.336263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.336745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.337210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.337896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.338347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.338768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.369807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:33.370237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-99f9914c-2b42-4287-bafd-f6521e33f234 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045170 Sep 05 14:45:33.370423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 771/1530] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:33.377988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-43a51f4f-db24-41ec-ace7-43b9423c784f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156381 Sep 05 14:45:33.381689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 760/1531] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:33.735303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:33.737449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:33.744195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.744669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.745095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.745776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:33.746221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:33.746641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:33.774342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1598d7fa-a794-4770-8304-5bb5a75c4fc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043234 Sep 05 14:45:33.775443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 772/1532] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:34.335018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:34.337147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:34.343594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.344074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.344534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.345263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.345661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.346082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.376450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ccf41e22-33c8-4043-8e32-f3309a895599 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045495 Sep 05 14:45:34.377075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 761/1533] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:34.381509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:34.383709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:34.390303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.390782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.391245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.391934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.392386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.392809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.403182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:34.403785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:34.409661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.410131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.410555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.411257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.411709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.412128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.422268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0d4cf607-5afa-4224-a483-4969e722d6df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044598 Sep 05 14:45:34.423059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 773/1534] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:34.542469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:34.550385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-721b4065-dc00-49dd-a719-2563b4e1deec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150995 Sep 05 14:45:34.550984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 762/1535] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:34.787301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:34.789511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:34.796021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.796500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.796935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.797616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:34.798066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:34.798490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:34.826176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-83805848-dd1b-4692-8e32-6dc4b1cacb37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042829 Sep 05 14:45:34.826936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 774/1536] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:35.389054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:35.391196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:35.397704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.398179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.402800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.402800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.402800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.402800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.429939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4cbebcee-1752-40a2-8f7f-305f5c7fa6b1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044987 Sep 05 14:45:35.430493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 763/1537] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:35.434781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:35.436986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:35.443622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.444105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.444536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.445219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.445672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.446093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.474700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-51d0c0b7-4a85-4199-af45-9c64b6fa07b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Sep 05 14:45:35.475282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 775/1538] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:35.573767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:35.574374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:35.580342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.580821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.581248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.581930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.582380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.582822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.715249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:35.722911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-15e39e9f-2238-41e4-849c-b9ad27e37bec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152981 Sep 05 14:45:35.723463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 764/1539] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:35.838400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:35.840572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:35.846426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.846933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.847370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.848050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:35.848502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:35.848922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:35.878204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-acc28bc2-c297-4ce7-a77e-4f27a22cf079 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043686 Sep 05 14:45:35.878742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 776/1540] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:36.441800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:36.443986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:36.450916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.451389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.451816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.452493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.452936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.453401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.482869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0b0be069-94b1-4b0d-9325-0010a3f1dd08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045094 Sep 05 14:45:36.483586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 765/1541] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:36.488922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:36.491149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:36.497627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.498111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.498546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.499262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.499713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.500135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.529561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-08469a72-2ae7-4f9f-a6e3-dd0848b0f255 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044744 Sep 05 14:45:36.530112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 777/1542] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:36.745672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:36.746274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:36.752184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.756817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.756817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.756817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.756817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.757261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.883459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:36.890431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:36.891687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-08f91152-d81a-4241-b9f4-509fba94c11b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149888 Sep 05 14:45:36.892314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 766/1543] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:36.892712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:36.898600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.899117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.899592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.900276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:36.900726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:36.901150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:36.929410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3077d50-7b9b-446a-8d76-a3cf1687477b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042855 Sep 05 14:45:36.929967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 778/1544] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:37.496336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:37.498444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:37.504809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.505278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.505706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.506378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.506847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.507265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.535809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fd72e31b-d9d4-4b79-bb6d-3deae25c2d04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044103 Sep 05 14:45:37.536438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 767/1545] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:37.544076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:37.546233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:37.552141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.552623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.553061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.553754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.554213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.554636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.583116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a11d6e5a-77fa-4f5d-ae1f-4091c7fab5fe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045038 Sep 05 14:45:37.583670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 779/1546] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:37.914685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:37.915779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:37.921726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.922206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.922641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.926002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.926002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.926002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.942229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:37.944396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:37.950141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.950618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.951113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.951793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:37.952238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:37.952655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:37.982402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1ab69ec-93b7-4cc3-be16-590b055eabdf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044061 Sep 05 14:45:37.983313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 780/1547] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:38.058649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:38.066306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6d0367f5-5832-46c1-b083-77cadff9803f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155598 Sep 05 14:45:38.066879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 768/1548] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:38.548939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:38.551110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:38.558027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:38.558505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:38.558964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:38.559648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:38.560101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:38.560523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:38.585832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:38.590717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-09006c17-f182-4420-97ba-044b41aba4cc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045814 Sep 05 14:45:38.591271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 781/1549] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:38.596271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:38.598434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:38.605326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:38.605798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:38.606227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:38.606941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:38.607388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:38.607806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:38.639608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-82d8c554-162a-4422-95f2-5196b6b4b0a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047457 Sep 05 14:45:38.640163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 769/1550] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:38.996314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:38.998503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:39.004740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.005222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.005652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.006334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.006781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.007229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.036312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f311bda-088e-4abf-b26e-61bbfd6fd1bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043978 Sep 05 14:45:39.036850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 782/1551] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:39.089398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:39.090002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:39.096528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.096528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.096823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.097502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.097945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.098369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.224429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:39.232277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fdf6d4fb-7eae-41b8-a6f4-0a8855060ce3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.146721 Sep 05 14:45:39.232831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 770/1552] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:39.603951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:39.606198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:39.612602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.613093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.613515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.614233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.614683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.615133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.644047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8365596a-2908-47ee-b138-c3b4e9959c4f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044885 Sep 05 14:45:39.644595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 783/1553] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:39.651317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:39.653454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:39.659844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.660324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.660755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.661437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:39.661887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:39.662309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:39.691955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-af2d5e1c-cf93-48be-9675-3e16ba533f3f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044486 Sep 05 14:45:39.692495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 771/1554] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:40.048766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:40.050972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:40.056827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.057302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.057729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.058433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.058914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.059340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.087706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d18c8fa5-589a-4cc6-9f2a-09ff236a1023 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042353 Sep 05 14:45:40.088247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 784/1555] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:40.255471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:40.256070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:40.262438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.262945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.263373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.264050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.264495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.264937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.396382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:40.404750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80442cd7-f268-4c32-aadf-d022d36ab839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153155 Sep 05 14:45:40.405310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 772/1556] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:40.655827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:40.657950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:40.664287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.664760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.665237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.665913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.666354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.666767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.696040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7456357-b9aa-4d8c-8cff-0ba0e82ee46a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Sep 05 14:45:40.697264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 785/1557] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:40.704178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:40.706289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:40.712741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.713212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.713637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.714316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:40.714758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:40.715207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:40.744053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7355b19e-a3ab-42b7-b0a1-cf9921106204 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043824 Sep 05 14:45:40.744595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 773/1558] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:41.100050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:41.102992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:41.109030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.109552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.109993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.110680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.111160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.111588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.140449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-661a1f4d-02f8-4239-9002-12296bab9c12 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044264 Sep 05 14:45:41.140991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 786/1559] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:41.427733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:41.428326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:41.434945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.435424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.435857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.436535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.436987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.437413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.567882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:41.576076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d23039f-ff44-4774-8e74-87f706ce0477 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152282 Sep 05 14:45:41.576636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 774/1560] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:41.709764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:41.711870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:41.718340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.718848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.719279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.719997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.720444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.720861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.752274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d8e19a0c-9152-4324-bce9-3bdc98393c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046520 Sep 05 14:45:41.752822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 787/1561] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:41.756651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:41.761060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:41.765235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.765718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.766156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.766878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:41.767341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:41.767764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:41.771359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:41.797190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7794ecda-79e1-4faa-a776-4074c9370d72 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Sep 05 14:45:41.797745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 775/1562] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:42.153294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:42.155490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:42.161389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.161869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.162290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.163012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.163458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.163872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.192542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-52bcc962-b12b-4b84-9abc-c6986ee007d0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Sep 05 14:45:42.193075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 788/1563] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:42.599397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:42.599951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:42.606759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.607277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.607686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.608431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.608875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.609296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.737415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:42.745011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-67e64727-5592-47ea-8ded-d64dde742e63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149949 Sep 05 14:45:42.745588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 776/1564] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:42.765435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:42.767659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:42.774032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.775216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.775655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.776337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.776787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.777238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.806068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-81b1eced-d005-43c4-9794-33d6545aeea2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044174 Sep 05 14:45:42.806620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 789/1565] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:42.816505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:42.818638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:42.825560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.826029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.826453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.827193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:42.827640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:42.828057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:42.857155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-14208f0c-9890-47fd-a71c-1c7abcd757c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044557 Sep 05 14:45:42.857624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 777/1566] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:43.204463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:43.206518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:43.212986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.213514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.213944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.214618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.215108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.215521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.243577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9b5a8bad-691b-4cf2-9f2d-bc972a11e911 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Sep 05 14:45:43.244116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 790/1567] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:43.768324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:43.768931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:43.775043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.775519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.775950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.776630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.777079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.777503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.818228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:43.820522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:43.827860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.828337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.828764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.829452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.829897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.830317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.859586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f44dd876-3a5e-439e-b28e-a6b0042c48b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045524 Sep 05 14:45:43.860147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 791/1568] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:43.869366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:43.871556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:43.877283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.877762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.878196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.878903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:43.879353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:43.879769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:43.908313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:43.909434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a9a1280-dc24-4622-bb9b-e617ba45e8e2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044326 Sep 05 14:45:43.910001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 792/1569] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:43.916646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b54a71bb-b973-41ea-b438-5ca522753151 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152207 Sep 05 14:45:43.917197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 778/1570] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:44.255462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:44.257630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:44.263487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.263965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.264396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.265079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.265540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.265962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.295541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-adef0ac6-f6d3-41d2-b8d3-a5a4db4d26da tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Sep 05 14:45:44.296082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 793/1571] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:44.872778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:44.874935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:44.881325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.881797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.882228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.882924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.883367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.883783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.913244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-725a67cf-36ff-42a6-8276-86a3a11dce44 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045011 Sep 05 14:45:44.913838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 779/1572] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:44.921993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:44.924147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:44.930569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.931662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.932090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.932772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.933219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.933633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.939403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:44.940018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:44.945917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.946427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.946887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.947574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:44.948018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:44.948433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:44.963286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-91b14906-ae03-4e16-96cb-679137ccd696 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045172 Sep 05 14:45:44.963839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 794/1573] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:45.079923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:45.088109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c019fbae-72d8-455e-92c3-8494d7ea6238 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152433 Sep 05 14:45:45.088671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 780/1574] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:45.308057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:45.310254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:45.316124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:45.316595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:45.317026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:45.317695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:45.318138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:45.318560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:45.346739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ce6854c-e279-4440-a979-66e9b964505d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042664 Sep 05 14:45:45.347316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 795/1575] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:45.926229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:45.928408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:45.934922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:45.935398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:45.935823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:45.936495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:45.936939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:45.937355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:45.965774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8f28068f-8644-471b-a931-2a5e530ad064 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043656 Sep 05 14:45:45.966307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 781/1576] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:45.975573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:45.978762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:45.985136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:45.985619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:45.986052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:45.986744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:45.987239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:45.987662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:46.015936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bdab09a3-086f-4ab9-b7e6-940ab810ff96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044323 Sep 05 14:45:46.016480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 796/1577] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:46.111027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:46.111641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:46.117711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:46.118222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:46.118654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:46.119386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:46.119894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:46.120344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:46.247364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:46.255064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-de6dedf5-06cb-46c5-81d3-aebb763d1975 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147934 Sep 05 14:45:46.255632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 782/1578] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:46.359110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:46.361232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:46.367288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:46.367765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:46.368243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:46.368924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:46.369374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:46.369796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:46.405101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cb4cf3b9-9f0b-47f9-bb18-7c0c8d748974 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050016 Sep 05 14:45:46.405657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 797/1579] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:46.979162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:46.981285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:46.987629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:46.988100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:46.988523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:46.989198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:46.989636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:46.990049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.019365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-131e6992-96a3-4dad-bf47-96f617147c00 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045104 Sep 05 14:45:47.019905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 783/1580] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:47.028188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:47.030390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:47.036404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:47.036886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:47.037318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.037999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:47.038451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:47.038898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.055598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:47.068527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cd583bc6-343b-4c5b-a2f1-1f64bfab97b7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Sep 05 14:45:47.072405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 798/1581] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:47.279283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:47.279810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:47.285685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:47.286162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:47.286592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.287309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:47.287755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:47.288171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.417872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:47.418279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:47.420542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:47.426555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a423a830-ec88-4d81-ba7f-043fff30bf0a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151181 Sep 05 14:45:47.427200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 784/1582] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:47.427545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:47.428142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:47.428572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.429260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:47.429708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:47.430125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:47.458535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5a2f6e7e-c527-43ad-ac81-73650aead79d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Sep 05 14:45:47.459104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 799/1583] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:48.032049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:48.034193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:48.040782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.041263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.041734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.042430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.042929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.043354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.074509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-99e57eaf-3d3e-492e-a2f7-9b1d2100a412 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046481 Sep 05 14:45:48.075105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 785/1584] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:48.083020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:48.085157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:48.091164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.091638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.092066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.092744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.093189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.093606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.122617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c0a276f4-c85c-45b7-8508-086cd1582d4b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043619 Sep 05 14:45:48.123953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 800/1585] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:48.450087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:48.450608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:48.456594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.457082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.457497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.458180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.458625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.459070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.474043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:48.477335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:48.485881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.486540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.487176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.488143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:48.488778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:48.489370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:48.531501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ab141535-761e-4fa6-a53a-c43d14b00bac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062929 Sep 05 14:45:48.532319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 801/1586] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:48.592520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:48.600195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-57ddeb20-3c9d-43b5-b09c-2c0e6f40a23b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154550 Sep 05 14:45:48.601008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 786/1587] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:49.087739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:49.090435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:49.097187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.097676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.098113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.098842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.099299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.099722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.129544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-46729818-32d0-4a08-bc56-172e213a8407 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046076 Sep 05 14:45:49.130118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 802/1588] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:49.136396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:49.138616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:49.141026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:49.145667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.146148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.146590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.147312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.147767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.148193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.178031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1f7af7e5-5442-4971-844d-24914a16d37a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046271 Sep 05 14:45:49.178595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 787/1589] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:49.546616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:49.548827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:49.557640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.558366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.559060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.560004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.560695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.561186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.590758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0f34e600-c7f4-4c9a-8a86-f62d7e8a8e67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048149 Sep 05 14:45:49.591333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 803/1590] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:49.624953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:49.625595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:49.634857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.635333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.635757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.636430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:49.637918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:49.639802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:49.997347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:50.005058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e38a6741-ca49-454e-b01b-6c0b316f0fc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.384309 Sep 05 14:45:50.005640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 788/1591] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:50.141671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:50.143953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:50.150710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:50.151226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:50.151659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:50.152353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:50.152805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:50.153222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:50.181907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-50ae537c-78ed-413b-b318-f3a9c014c9f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044270 Sep 05 14:45:50.182454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 804/1592] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:50.191065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:50.193247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:50.200795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:50.201286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:50.201756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:50.202473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:50.203112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:50.203726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:50.234314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-359b37c4-40a9-46bf-a8be-d444d3ef5a02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047186 Sep 05 14:45:50.234893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 789/1593] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:50.603599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:50.605772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:50.612134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:50.612615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:50.613087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:50.613776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:50.614228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:50.614652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:50.644622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-212de675-7d1c-4aca-96d7-a3bf197a8e97 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045353 Sep 05 14:45:50.645176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 805/1594] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:51.034844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:51.035448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:51.041936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.042408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.042892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.043569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.044016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.044429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.187378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:51.198596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:51.199152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a3eaf824-a988-4895-adea-bd374f650722 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.163222 Sep 05 14:45:51.199152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 790/1595] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:51.199576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:51.201723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.202202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.202633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.203360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.203811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.204233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.234372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-575bd369-b3f2-45af-bd09-8d12137f5935 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 Sep 05 14:45:51.234954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 806/1596] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:51.246228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:51.248449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:51.255208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.255691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.256131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.256825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.257280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.257704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.283121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:51.287675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c96efcdd-0c1d-4580-a780-969b6a823ecc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045387 Sep 05 14:45:51.288235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 791/1597] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:51.658317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:51.660568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:51.667114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.667612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.668034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.668731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:51.669185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:51.669605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:51.699789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ca0eff18-cb76-459d-b45c-9bcac8c841f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045854 Sep 05 14:45:51.700351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 807/1598] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:52.216451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:52.217057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:52.223519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.223999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.224430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.225220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.225670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.226359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.247760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:52.249900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:52.255792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.256272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.256705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.257396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.257844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.258268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.287828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-05818a76-f3e7-4b9e-bc73-36f9e1c5c0ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044702 Sep 05 14:45:52.288393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 808/1599] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:45:52.303260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:52.306709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:52.312657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.313135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.313569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.314284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.314737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.315186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.344746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f962dce9-8cd6-4e40-b48b-c86fd8dfc3f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045262 Sep 05 14:45:52.345304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 809/1600] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:52.360879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:52.369151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8a4d4d0e-febd-4826-a5bd-1a10005c753c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156677 Sep 05 14:45:52.369705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 792/1601] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:52.712925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:52.715101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:52.721622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.722131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.722567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.723338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:52.723799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:52.724228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:52.754020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f88708fc-6d07-4123-a0e7-7c8af9523f64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045695 Sep 05 14:45:52.754568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 810/1602] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:53.300937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:53.303223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:53.310362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.310873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.311332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.312021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.312471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.312895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.347312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d971427c-2aa2-4b30-8718-a1159269fb8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050315 Sep 05 14:45:53.347781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 793/1603] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:53.357294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:53.359514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:53.361374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:53.366220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.366705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.367170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.368361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.368931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.369384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.391523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:53.392216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:53.398702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.399271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.399702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.400385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.400832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.401247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.402018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d2f0c40-5de1-44eb-9398-99f977465dce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048588 Sep 05 14:45:53.402584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 811/1604] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:53.531953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:53.539870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a14e82e-910d-46c4-a4b9-834ee061da34 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152744 Sep 05 14:45:53.540426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 794/1605] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:45:53.766267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:53.768477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:53.774739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.775244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.775670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.776348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:53.776792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:53.777208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:53.806273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9702a95a-b854-480e-bad5-05f2154bb557 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043336 Sep 05 14:45:53.806834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 812/1606] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:54.359735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:54.361798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:54.368186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.368656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.369083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.369780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.370226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.370635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.399214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c8c15a82-b12c-4be3-8467-2e4bc0eaeb2a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043465 Sep 05 14:45:54.404479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 795/1607] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:54.413722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:54.415999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:54.422088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.422578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.423047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.423754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.424209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.424635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.454617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-33f9f960-6fa1-415c-bbde-618580636438 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Sep 05 14:45:54.455374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 813/1608] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:54.563882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:54.564490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:54.570507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.571545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.571982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.572661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.573110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.573592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.700754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:54.708485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb38e394-7507-46f7-941c-00fadd007b1a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148573 Sep 05 14:45:54.709047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 796/1609] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:54.818765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:54.820934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:54.827814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.828285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.828711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.829383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:54.829828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:54.830248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:54.857807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6547efa9-2f78-471c-ba5b-100e3015d404 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042985 Sep 05 14:45:54.858342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 814/1610] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:55.417051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:55.419159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:55.425572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.426045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.426478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.427191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.427642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.428060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.457210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3219b7d-2a6a-4134-b83d-73148d40aa8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044743 Sep 05 14:45:55.457755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 797/1611] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:55.467190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:55.469341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:55.475295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.475801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.476487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.477170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.478121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.478545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.482102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:45:55.510118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dfd2c26a-bd55-408e-9ae6-051f035276ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046857 Sep 05 14:45:55.510670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 815/1612] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:55.732968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:55.733615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:55.739501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.739984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.740418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.741108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.741563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.741991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.870401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:55.872014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:55.872617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:55.879114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.879601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.879793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-856073c2-cdb0-41cb-b3a0-41b021353c3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150768 Sep 05 14:45:55.880036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.880350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 798/1613] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:55.880751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:55.881299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:55.881735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:55.911187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-24e5afe5-a63d-4394-ab1a-b95217c4c78b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045070 Sep 05 14:45:55.911731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 816/1614] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:56.469726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:56.471955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:56.478811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.479316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.479751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.480436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.480886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.481307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.510894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f5f59fc4-6853-4c64-b4c7-535282c12953 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045171 Sep 05 14:45:56.511427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 799/1615] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:56.521444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:56.523687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:56.529566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.530042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.530471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.531188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.531641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.532063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.561317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ec012a08-636d-4323-93e5-add52a4f3d1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043787 Sep 05 14:45:56.561848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 817/1616] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:56.903214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:56.903748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:56.909592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.910068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.910493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.911213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.911658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.912071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.923099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:56.925216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:56.932073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.932572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.933000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.933679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:56.934128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:56.934543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:56.963427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d6ecbf85-b03d-4784-aa39-1ee8aed417fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044202 Sep 05 14:45:56.963983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 818/1617] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:45:57.041364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:57.049238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55d5237b-84b2-42b4-9ff9-2f92b84516c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149953 Sep 05 14:45:57.049801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 800/1618] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:57.523345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:57.525467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:57.531569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:57.532040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:57.532466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:57.533137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:57.533581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:57.533998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:57.562951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-397b786f-91f7-489e-aa84-e3dd410174f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043606 Sep 05 14:45:57.563494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 819/1619] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:57.573537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:57.575791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:57.582076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:57.582553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:57.583043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:57.583703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:57.584150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:57.584573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:57.613595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a8be57c7-26a2-4037-a087-adb7ea1ec3a2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044073 Sep 05 14:45:57.614134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 801/1620] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:57.975415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:57.978431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:57.984777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:57.985250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:57.985675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:57.986348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:57.986817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:57.987232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.014670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7497b385-0428-422f-9755-2bc63bd223d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043184 Sep 05 14:45:58.015553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 820/1621] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:58.072186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:58.072793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:58.078991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:58.079476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:58.079909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.080603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:58.081050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:58.081469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.212803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:58.220438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2596354c-41e2-4242-ac16-e106e1e4bf40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152125 Sep 05 14:45:58.220993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 802/1622] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:58.576513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:58.578633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:58.584589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:58.585070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:58.585505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.586204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:58.586635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:58.587086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.615507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-49fd4df0-e7eb-420e-b147-7c00a2c65383 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043153 Sep 05 14:45:58.616060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 821/1623] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:58.625562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:58.627799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:58.634925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:58.635417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:58.635851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.636724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:58.637175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:58.637629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:58.666671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56c80028-4feb-4335-a33e-bf83c0a134ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045054 Sep 05 14:45:58.667260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 803/1624] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:59.027073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:59.029250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:59.035544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.037382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.037382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.037382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.037694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.038029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.066905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-29bc0932-dea2-4414-8c43-7424b4682ef0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043808 Sep 05 14:45:59.067443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 822/1625] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:45:59.242506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:59.243777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:59.249684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.250158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.250591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.251307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.251760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.252180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.380361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:45:59.386770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aaa43f5b-0b47-4b5b-b10f-4dd39130ed88 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148124 Sep 05 14:45:59.387358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 804/1626] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:45:59 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:45:59.628667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:59.630758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:59.637252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.637727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.638154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.638848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.639298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.639716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.668242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b7f47527-c5ee-43fc-8db0-8e97c3b842dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043684 Sep 05 14:45:59.668784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 823/1627] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:45:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:45:59.679487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:45:59.681630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:45:59.687685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.688161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.688594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.689274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:45:59.689726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:45:59.690146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:45:59.720017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0ecad512-eb66-4120-9c44-21a9fe70df99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044941 Sep 05 14:45:59.720565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 805/1628] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:45:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:00.079081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:00.081304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:00.088124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.088609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.089048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.089751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.090208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.090634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.120216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4af2da4-d597-4e1d-b0e3-14f5be312fad tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045199 Sep 05 14:46:00.120765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 824/1629] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:00.410131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:00.410659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:00.417154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.417627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.418054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.418730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.419201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.419623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.550414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:00.558677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb048097-bdc2-4abb-bec8-928aa26be952 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152485 Sep 05 14:46:00.559339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 806/1630] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:00.680907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:00.683113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:00.689303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.689773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.690200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.690935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.691387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.691803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.721698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5966c536-7feb-4860-99be-6718c83351c7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044839 Sep 05 14:46:00.722245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 825/1631] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:00.732514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:00.734681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:00.740941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.741413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.741845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.742554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:00.743026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:00.743444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:00.772103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-10882899-9597-4b94-8487-eb437ccddf13 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043587 Sep 05 14:46:00.772640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 807/1632] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:01.132470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:01.135398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:01.141758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.142227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.142654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.143367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.143814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.144227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.172551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06b112bc-e092-4147-8e5b-2fc8a6df918c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044032 Sep 05 14:46:01.173091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 826/1633] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:01.581466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:01.582077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:01.588101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.588582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.589014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.589708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.590146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.590568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.608307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:01.718635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:01.726766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-392686e5-bf09-458e-9d6f-80fe840bf985 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149234 Sep 05 14:46:01.731366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 808/1634] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:01.733666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:01.735881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:01.741778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.742255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.742681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.743923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.744373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.744791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.773653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-92fe5082-26f7-4f1d-a05e-684b6e7533ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044024 Sep 05 14:46:01.774197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 827/1635] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:01.785050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:01.787284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:01.793618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.794096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.794527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.795249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:01.795697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:01.796116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:01.825696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b786fd6a-e472-4f94-8200-2d9e560b3e9d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044739 Sep 05 14:46:01.828823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 809/1636] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:02.184920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:02.187149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:02.193411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.193885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.194313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.195046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.195495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.196421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.224906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f8f04e3c-e945-4fe6-b253-ce67531eb20a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044003 Sep 05 14:46:02.225449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 828/1637] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:02.750177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:02.750799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:02.756780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.757257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.757689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.758369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.758850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.759279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.786002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:02.788185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:02.794956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.795430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.795857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.796536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.797242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.797674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.828433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48794921-0688-44ff-ba90-d15ba8db3318 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046323 Sep 05 14:46:02.828986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 829/1638] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:02.838823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:02.840922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:02.846714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.847230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.847661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.848343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:02.848788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:02.849204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:02.879751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ffa92c41-3837-48c3-bef6-8a9dd274808e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044549 Sep 05 14:46:02.880313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 830/1639] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:02.889043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:02.896604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-40494121-9b29-4fea-bc99-6f218956e247 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150324 Sep 05 14:46:02.897149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 810/1640] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:03.237633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:03.239784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:03.247480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.247958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.248417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.249106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.249556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.250027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.273870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:03.278923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6dbeb8e2-2c8d-49a6-8bb5-e18084c36d7e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045468 Sep 05 14:46:03.279468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 831/1641] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:03.840000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:03.842183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:03.848636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.849111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.849543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.850226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.850675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.851379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.880054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d9fb6036-540f-4d4c-8e85-812812d6d208 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044083 Sep 05 14:46:03.880591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 811/1642] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:03.892693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:03.894898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:03.900901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.901376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.901803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.902478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.902952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.903370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.919744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:03.920281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:03.926241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.926722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.927194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.927889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:03.928340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:03.928761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:03.933020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d9111626-3248-4d36-babc-dd1c1b3f13f3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Sep 05 14:46:03.933651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 832/1643] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:04.061752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:04.069488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-09a5bf79-61fc-491d-98ac-424a12a6b16f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153644 Sep 05 14:46:04.070058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 812/1644] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:04.291815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:04.293937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:04.295889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:46:04.296034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:46:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments (ip 10.222.0.15) !!! Sep 05 14:46:04.303748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:04.304220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:04.304649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:04.305325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:04.305770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:04.306185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:04.336178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-438a26d1-9d57-46da-8fa8-376b98e31904 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048918 Sep 05 14:46:04.336718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 833/1645] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:04.892747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:04.894900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:04.901273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:04.901747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:04.902181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:04.902890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:04.903338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:04.903757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:04.933266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7dbf2c7b-0ebc-4f63-9eec-3f32c49e54f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044481 Sep 05 14:46:04.933843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 813/1646] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:04.945585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:04.947747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:04.953683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:04.954156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:04.954584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:04.955296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:04.955743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:04.956159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:04.985373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-64ad38c1-c9dc-4379-b2d7-f06e57fa0295 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043858 Sep 05 14:46:04.985927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 834/1647] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:05.093139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:05.093747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:05.099688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:05.100171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:05.100605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:05.101543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:05.101993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:05.102416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:05.238360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:05.241621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1cc1cf26-c9dd-435b-97ec-b2ebb275f348 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152404 Sep 05 14:46:05.242172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 814/1648] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:05 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:05.348404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:05.350536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:05.357797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:05.358274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:05.358705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:05.359440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:05.359895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:05.360316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:05.388086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd7ed044-c662-4e29-a03f-0a2d98875660 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Sep 05 14:46:05.388626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 835/1649] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:05.945722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:05.947947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:05.954379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:05.954879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:05.955316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:05.955999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:05.956447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:05.956863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:05.985981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3669e7cd-0636-4360-bb14-3ee18327c159 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044327 Sep 05 14:46:05.986518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 815/1650] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:05.998187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:06.000392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:06.006269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:06.006748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:06.007216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:06.007895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:06.008343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:06.008765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:06.037274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e4bd451-98cc-477a-bdff-18f70404c62d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043762 Sep 05 14:46:06.037820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 836/1651] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:06.265266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:06.265905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:06.271906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:06.272421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:06.272930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:06.273613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:06.274068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:06.274495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:06.400608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:06.402871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:06.409711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:06.410194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:06.410396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:06.410626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:06.411365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:06.411817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:06.412241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:06.419922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e3a02bea-8fbe-4fa9-aae4-b8560d7042e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.158792 Sep 05 14:46:06.420502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 816/1652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:06.442615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f6089ce-89e1-418e-9ad2-35f29c97d7c1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046145 Sep 05 14:46:06.443187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 837/1653] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:06.998285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:07.000425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:07.006905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.007381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.007809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.008482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.008929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.009341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.039703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a1cd307f-24ee-4089-8274-dcfea4bac2a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045464 Sep 05 14:46:07.040249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 817/1654] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:07.049589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:07.051825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:07.057727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.058205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.058639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.059368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.059823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.060262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.090025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ec80589-c569-40ff-824d-92634557c8c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043723 Sep 05 14:46:07.090584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 838/1655] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:07.443699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:07.444256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:07.450948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.451422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.451854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.452531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.452975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.453392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.455427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:07.457765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:07.464096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.464575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.465008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.465726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:07.466177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:07.466596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:07.497293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4455e178-022a-4f23-90b0-192487b4bfe8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045103 Sep 05 14:46:07.497876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 839/1656] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:07.583167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:07.590678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aadefce4-80b9-4a42-b6a7-0b8d776642a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150955 Sep 05 14:46:07.591265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 818/1657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:08.053045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:08.055264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:08.062335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.062832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.063262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.063938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.064385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.064802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.096178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8ce2a0b-e7e8-4630-a4e4-0bd1840f7b57 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047163 Sep 05 14:46:08.096748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 840/1658] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:08.101680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:08.103898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:08.110424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.110927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.111359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.112036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.112479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.112894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.142328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c24d9032-e6f9-4711-b7ed-fc5d77a8febb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044801 Sep 05 14:46:08.142885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 819/1659] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:08.509504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:08.511657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:08.518486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.519002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.519433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.520104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.520545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.520960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.549050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1cd95dc6-fc2a-42f4-98e5-abf8cf259b2c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Sep 05 14:46:08.549581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 841/1660] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:08.614027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:08.614579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:08.620582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.621116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.622248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.622969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:08.623414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:08.623831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:08.752229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:08.759892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fe4ea5cd-2d98-4235-abc7-2d994499c497 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150036 Sep 05 14:46:08.760450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 820/1661] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:09.109409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:09.111579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:09.117522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.118001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.118429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.119130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.119577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.119994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.148140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8ac0ae52-c2e4-4f39-8eea-bfac25c4405e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043332 Sep 05 14:46:09.148683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 842/1662] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:09.155822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:09.157974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:09.164239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.164757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.165190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.165867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.166312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.166728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.196283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-691d6152-32ea-48ba-a10b-0483f6e9b486 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044989 Sep 05 14:46:09.196823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 821/1663] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:09.561441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:09.563585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:09.569853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.570323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.570750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.571446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.571893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.572308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.601537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f979537-014d-448b-bb1b-0527cfe639ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043863 Sep 05 14:46:09.602077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 843/1664] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:09.782865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:09.783490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:09.789423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.789908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.790341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.791049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:09.791502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:09.791920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:09.921342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:09.929037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b0bf3b86-76df-452e-87a7-893cdea3f000 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150100 Sep 05 14:46:09.929602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 822/1665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:10.160792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:10.163432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:10.169287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.170263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.170691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.171392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.171840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.172255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.201182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cbc34949-b48d-4896-b5d3-c60f1fdbd71a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044431 Sep 05 14:46:10.201728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 844/1666] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:10.208041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:10.210186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:10.216564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.217024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.217460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.218144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.218598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.219095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.248736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0ffa69bd-944b-4b5e-a5cc-eb57f4980fcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Sep 05 14:46:10.249277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 823/1667] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:10.614118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:10.616365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:10.622703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.623260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.623685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.624358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.624805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.625219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.652924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-401ea55d-9a68-4bbd-975d-f955d25f093f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Sep 05 14:46:10.653452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 845/1668] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:10.952894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:10.953443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:10.959463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.959942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.960375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:10.961053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:10.961500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:10.961919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.097551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:11.105523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8c79d245-12a4-4e94-af8e-9d36ca864355 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.157085 Sep 05 14:46:11.106086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 824/1669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:11.213661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:11.215826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:11.221942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:11.222430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:11.222890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.223576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:11.224024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:11.224443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.253177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cc8e66bb-78dc-4017-9ef4-8464f3b480ad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043640 Sep 05 14:46:11.253715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 846/1670] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:11.260968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:11.263136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:11.270037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:11.270508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:11.270985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.271662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:11.272106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:11.272522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.276043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:11.300661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5dd5249d-87d2-434c-8f99-bf5ec3797cd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Sep 05 14:46:11.301196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 825/1671] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:11.666177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:11.668340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:11.675297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:11.675774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:11.676200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.676881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:11.677332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:11.677751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:11.706657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c0295b7d-16e2-44aa-ba3d-7ef9eea26415 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Sep 05 14:46:11.707221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 847/1672] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:12.131725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:12.132354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:12.138251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.138721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.139173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.139847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.140288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.140704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.265617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:12.267781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:12.273342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:12.274042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.274530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.275009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.276067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.276529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.276955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.281732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-77a5960b-113e-42bf-a0e2-9566fd567f27 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154263 Sep 05 14:46:12.282304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 826/1673] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:12.294349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:12.307165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9d5e0848-e44b-4529-8dc3-6f78d8fc39e1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046060 Sep 05 14:46:12.307947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 848/1674] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:12.312771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:12.314971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:12.320792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.321269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.321704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.322389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.322867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.323295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.353156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24be7284-0fa3-41bc-8329-f7ce45c7109d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044243 Sep 05 14:46:12.353610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 827/1675] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:12.719375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:12.721552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:12.728317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.728789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.729221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.729898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:12.730347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:12.730766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:12.759010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b223e79-6df9-456b-97e3-5e2e61199d4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044440 Sep 05 14:46:12.759550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 849/1676] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:13.304989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:13.305629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:13.312077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.312580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.313022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.313717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.314180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.314601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.319133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:13.321297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:13.327880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.328354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.332202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.332202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.332202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.332202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.360471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4215664-18aa-42a7-9db0-894b4f4e4cc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045156 Sep 05 14:46:13.360949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 850/1677] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:13.365467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:13.367618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:13.373219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.373696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.374633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.375335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.375784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.376205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.406156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a2871c3-a441-43f9-b780-39ba3a7f5e4a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044186 Sep 05 14:46:13.406902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 851/1678] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:13.448432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:13.456760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aab18440-af0b-4694-a744-a70654bbdc83 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155759 Sep 05 14:46:13.457317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 828/1679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:13.771581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:13.773776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:13.780106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.780577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.781003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.781674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:13.782119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:13.782545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:13.811115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-92845c46-4191-4299-85e4-7040b1cbbf2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Sep 05 14:46:13.812238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 852/1680] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:14.373238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:14.375459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:14.381410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.381887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.382322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.383034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.383482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.383902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.412556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4470de73-e05d-4a8e-8802-ff6267589258 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043401 Sep 05 14:46:14.412887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 829/1681] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:14.417577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:14.419784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:14.426347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.426857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.427295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.427981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.428434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.428856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.457109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ed5a01b-625e-4f01-9813-1e99f8dee312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043477 Sep 05 14:46:14.457648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 853/1682] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:14.478852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:14.479457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:14.485943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.486413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.486863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.487535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.487977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.488391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.617662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:14.625332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5a282e4f-1255-4983-8ba6-655c1d2e728e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150519 Sep 05 14:46:14.625825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 830/1683] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:14.824162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:14.826372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:14.833281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.833758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.834190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.834909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:14.835362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:14.835780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:14.864602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4164de13-9ff6-43e5-91bf-8e8fdbf75c9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044461 Sep 05 14:46:14.865144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 854/1684] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:15.426028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:15.428136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:15.434527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.435033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.435461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.436133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.436574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.436987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.465701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-77ba1424-5d8c-49be-ac6b-44666df89649 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044300 Sep 05 14:46:15.466244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 831/1685] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:15.469496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:15.471741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:15.477945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.478421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.478877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.479564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.480016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.480436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.509889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-36e1fe4d-6a3b-4746-a4b8-26a4880c3020 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044496 Sep 05 14:46:15.510433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 855/1686] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:15.648513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:15.649122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:15.654918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.655394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.655817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.656491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.657446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.657843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.785170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:15.792861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-08f38ef2-08c4-43f2-863d-d3897325668d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148134 Sep 05 14:46:15.793420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 832/1687] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:15.876254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:15.878439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:15.884751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.885229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.885661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.886345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:15.886805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:15.887242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:15.915717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f3179390-6d50-464e-86cc-dca35e0e5c80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043376 Sep 05 14:46:15.916249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 856/1688] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:16.477790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:16.479948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:16.486335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.486931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.487366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.488048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.488494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.488912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.518400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-642e2a65-0879-4fd8-8fca-88b8f84f4352 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044818 Sep 05 14:46:16.518966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 833/1689] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:16.522422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:16.530235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:16.531047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.531525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.531955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.532635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.533097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.533515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.561578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b9709729-7c2e-498e-bf07-169880e70978 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043180 Sep 05 14:46:16.562121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 857/1690] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:16.817026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:16.817663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:16.823481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.823957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.824384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.825060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.825507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.825923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.928739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:16.930861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:16.936594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.937071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.937499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.938173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:16.938623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:16.939730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:16.953546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:16.961169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-035c8116-104f-4406-ad7c-de7af7f3eeb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148611 Sep 05 14:46:16.961728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 834/1691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:16.968461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5fb37620-2ae1-4b50-9297-0f8bf49f62df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043730 Sep 05 14:46:16.969013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 858/1692] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:17.530970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:17.533701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:17.540144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.540614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.541040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.541715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.542157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.542578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.571327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bba8f17b-7ecd-4054-b616-217fd112a963 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044363 Sep 05 14:46:17.571868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 835/1693] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:17.574410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:17.576606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:17.583539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.584021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.584458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.585143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.585598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.586019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.615315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40201570-682c-4f78-9fe9-db838c54b1cd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044812 Sep 05 14:46:17.615863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 859/1694] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:17.981073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:17.983273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:17.984192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:17.984798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:17.989268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.989750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.990205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.990522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.990910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.991020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.991363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.991469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.991782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:17.992105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:17.992550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:17.992972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:18.021732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c65778b-86bc-4b9f-baeb-177c38a58f66 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044599 Sep 05 14:46:18.022483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 836/1695] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:18.124923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:18.133195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3e083e8-b087-4896-a82e-04b99f22ef9b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152820 Sep 05 14:46:18.133753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 860/1696] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:18.583679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:18.585836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:18.588212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:18.592833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:18.593302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:18.593729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:18.594406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:18.594873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:18.595800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:18.625613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-04bfdc7a-219e-4f4c-b4f4-0ba15e1120e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045865 Sep 05 14:46:18.626171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 837/1697] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:18.627964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:18.630322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:18.632673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:18.637305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:18.637782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:18.638214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:18.638997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:18.639450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:18.639874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:18.669594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-da406621-8ee0-4a0a-b492-c2e65f8f6ae9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045680 Sep 05 14:46:18.670224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 861/1698] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:19.034904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:19.037069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:19.042849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.043329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.043761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.044438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.044889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.045309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.072821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c393e379-61d4-43a7-9267-8429080ba996 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042889 Sep 05 14:46:19.073371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 838/1699] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:19.156447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:19.157059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:19.163970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.164450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.164888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.165567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.166021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.166440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.293960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:19.301649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3dfab093-814b-449c-9e3a-e9d2588799e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149111 Sep 05 14:46:19.302214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 862/1700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:19.638356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:19.640492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:19.646837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.647317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.647751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.648433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.648879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.649299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.678095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f1853b04-bc09-4c5e-a7b9-b03cda7e847c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043786 Sep 05 14:46:19.678698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 839/1701] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:19.682710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:19.684856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:19.691162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.691633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.692750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.693430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:19.693879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:19.694297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:19.723280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a8781858-d734-4356-b887-290f63c98859 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Sep 05 14:46:19.723824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 863/1702] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:20.085684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:20.087856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:20.093824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.094299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.094726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.095449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.095893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.096802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.125647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8598feb0-193d-4001-a2c0-bdeda1f05b81 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044250 Sep 05 14:46:20.126184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 840/1703] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:20.323846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:20.324456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:20.330391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.330905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.331338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.332014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.332472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.332891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.464769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:20.472374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0071161d-3669-4aa5-aa0e-118ad658bd02 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152411 Sep 05 14:46:20.472940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 864/1704] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:20.690964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:20.693084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:20.699442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.699915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.700341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.701014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.701456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.701873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.727090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:20.731792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96ab1429-26c7-4bcb-9133-a38eb4b5edd4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045000 Sep 05 14:46:20.732260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 841/1705] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:20.735697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:20.737880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:20.744276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.744755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.745188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.745939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:20.746404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:20.746844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:20.750372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:20.776228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2e2bd2d1-20e7-4b12-811f-24583598e14b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044637 Sep 05 14:46:20.776780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 865/1706] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:21.137827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:21.140000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:21.146465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.146975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.147408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.148081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.148527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.148942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.177294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bab3cd2e-f386-49b3-8634-4595a70e14b6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Sep 05 14:46:21.177833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 842/1707] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:21.495528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:21.496138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:21.502559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.503068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.503503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.504183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.505138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.505557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.632342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:21.639981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7e71fc4c-f3b0-402a-abf7-5b04d8983286 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148331 Sep 05 14:46:21.640540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 866/1708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:21.743886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:21.746146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:21.752430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.752906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.753337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.754019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.755044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.755408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.784473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22c9db6b-5b91-4c26-a8d2-b407abd70279 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044656 Sep 05 14:46:21.785036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 843/1709] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:21.788688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:21.790950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:21.797402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.797906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.798368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.799081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:21.799538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:21.799989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:21.829409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2a8fe9ca-6ce5-40bb-bd4a-f629aba50ac8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Sep 05 14:46:21.829962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 867/1710] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:22.189704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:22.192506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:22.198399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.198918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.199352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.200036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.200520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.200945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.229419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-443a059b-b5e6-4bd7-ace5-1da539b5b226 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043772 Sep 05 14:46:22.229956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 844/1711] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:22.664507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:22.665150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:22.671300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.671788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.672222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.672915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.673368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.673814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.797178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:22.799262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:22.801554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:22.805667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.806144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.806573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.807308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.807761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.808182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.809763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-446f05b0-31fb-4672-b2fb-0852fa30f4d5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149809 Sep 05 14:46:22.810337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 868/1712] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:22.837526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a87418d6-f37a-4238-b285-35ca769dde06 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044442 Sep 05 14:46:22.838338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 845/1713] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:22.841715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:22.843965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:22.850576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.851091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.851802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.852490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:22.852948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:22.853377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:22.881748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-802e75ac-041c-4c96-bbe5-effd6a0ec9f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043929 Sep 05 14:46:22.882300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 869/1714] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:23.241657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:23.243862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:23.249682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.250163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.250597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.251314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.251765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.252190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.281529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-90f85a65-1b5e-46e1-9670-755822017d9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043846 Sep 05 14:46:23.282068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 846/1715] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:23.832748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:23.833355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:23.839757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.840228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.840654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.841325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.841771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.842183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.849953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:23.852934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:23.859228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.859708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.860136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.860820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.861261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.861678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.893563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a8eae514-73eb-4e85-a9ba-3d7afd85dbb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047988 Sep 05 14:46:23.894146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 847/1716] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:23.898721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:23.900877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:23.906498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.907025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.907459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.908128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:23.908576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:23.908989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:23.938657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-64d07cd4-538b-4236-b62f-37e37fc76d86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043492 Sep 05 14:46:23.939245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 848/1717] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:23.975824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:23.983769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fa7d93e5-d157-48a6-8285-d4b5da0a1841 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154855 Sep 05 14:46:23.984325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 870/1718] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:24.294157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:24.296343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:24.302208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:24.302683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:24.303271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:24.303954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:24.304401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:24.304823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:24.332875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-99731cb1-d7d4-4763-871b-92580e4b4730 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042313 Sep 05 14:46:24.333410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 849/1719] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:24.906039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:24.908219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:24.914516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:24.915030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:24.915465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:24.916164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:24.916614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:24.917037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:24.948370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e66d2ee7-7f13-464e-b13a-80f3b3882d07 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046284 Sep 05 14:46:24.948929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 871/1720] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:24.951056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:24.953364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:24.959710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:24.961819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:24.961819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:24.961819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:24.961819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:24.962250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:24.990926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-904cae16-1cd1-4ce1-9b78-07e975c5c3db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043827 Sep 05 14:46:24.991466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 850/1721] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:25.013397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:25.013397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:25.014170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:25.014681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:25.015148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:25.015845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:25.016305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:25.016732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:25.149174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:25.156958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-186505ac-8dc4-4487-8e3b-f88ce6c68d69 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153874 Sep 05 14:46:25.157517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 872/1722] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:25.345347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:25.347432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:25.354025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:25.354499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:25.354961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:25.355638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:25.356083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:25.356499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:25.384749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e66a78eb-4b34-423f-9e87-8b923ee1f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043515 Sep 05 14:46:25.385282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 851/1723] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:25.961487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:25.963619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:25.969928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:25.970398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:25.970845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:25.971523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:25.971966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:25.972382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.001364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cc24ce73-dea0-4d1e-aad6-478e933c3551 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044352 Sep 05 14:46:26.001907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 873/1724] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:26.003337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:26.005975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:26.012325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:26.012812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:26.013244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.013927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:26.014380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:26.014818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.044064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d3891624-e991-4cdd-a86c-e44b587449f9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044642 Sep 05 14:46:26.044614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 852/1725] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:26.179215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:26.179826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:26.185737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:26.186215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:26.186676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.187393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:26.187842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:26.188262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.321806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:26.329694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-734405f3-31bb-4714-bd4a-9e473e9d918d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154310 Sep 05 14:46:26.330254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 874/1726] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:26.396630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:26.398760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:26.404668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:26.405137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:26.405565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.406237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:26.406684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:26.407129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:26.440794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-73bc2f84-0521-4375-a7a1-0b4d78af69cc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045593 Sep 05 14:46:26.441367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 853/1727] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:27.014095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:27.016286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:27.022708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.023215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.023642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.024315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.024761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.025181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.055647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8057cde7-0364-42c8-945f-b0a253809cec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045509 Sep 05 14:46:27.056188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 875/1728] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:27.057123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:27.059330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:27.061324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:46:27.061472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:46:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments (ip 10.222.0.15) !!! Sep 05 14:46:27.069116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.069586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.070020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.070716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.071205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.071630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.110666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1a91a69c-9893-4625-b417-6db6c4d656cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057659 Sep 05 14:46:27.111282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 854/1729] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:27.353975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:27.354502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:27.360376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.360844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.361269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.361941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.362386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.362822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.453536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:27.456172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:27.462576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.463082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.463510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.464202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:27.464644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:27.465064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:27.492927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:27.494305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3a50c7bb-215e-446d-867a-9a6eb609e28c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044698 Sep 05 14:46:27.494902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 855/1730] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:27.500983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8c37bb57-e9c6-4ca4-9f18-0265a1bd50f6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151358 Sep 05 14:46:27.501536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 876/1731] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:28.068985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:28.071199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:28.077990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.078465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.078985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.079672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.080149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.080566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.110817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49aee0a9-c721-4453-9657-d1fc3b4691cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046736 Sep 05 14:46:28.111457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 856/1732] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:28.123590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:28.125719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:28.132182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.132660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.133092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.133774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.134223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.134643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.163978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ba18a0f-881c-4253-903d-db1f3966a11c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044313 Sep 05 14:46:28.164454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 877/1733] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:28.507161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:28.509288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:28.515126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.515600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.516027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.516703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.517147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.517561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.524798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:28.525436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:28.531275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.531761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.532193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.532880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:28.533329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:28.533747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:28.546584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7720a2cb-00c6-497a-b9a7-c5d07c785ff5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043847 Sep 05 14:46:28.547164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 857/1734] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:28.665572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:28.673366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b4e88610-3686-4ed6-939c-8abc9a75a488 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153039 Sep 05 14:46:28.673925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 878/1735] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:29.123470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:29.125590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:29.131976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.132443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.132870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.133544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.133990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.134405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.151284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:29.164279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-907f7608-7da9-4e8c-999a-d81428473587 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044854 Sep 05 14:46:29.168348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 858/1736] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:29.176706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:29.178881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:29.185228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.185695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.186128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.186836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.187291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.187711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.216148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7982f9bd-799a-4277-94f1-28b2ad035f08 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044010 Sep 05 14:46:29.216684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 879/1737] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:29.559206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:29.561217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:29.567315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.567790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.568224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.568901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.569351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.569769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.598964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1a4714e1-7562-4c8e-8da0-f2a396f0e35e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043611 Sep 05 14:46:29.599504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 859/1738] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:29.696432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:29.697035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:29.702930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.703408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.703838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.704517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:29.704964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:29.705387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:29.834146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:29.841806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e7b174e-8350-4e18-806a-6588456d66ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149282 Sep 05 14:46:29.842366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 880/1739] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:30.179105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:30.181269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:30.187693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.188172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.188607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.189291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.189739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.190162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.218918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4658267-936b-4806-96dd-62aaac0787bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043963 Sep 05 14:46:30.219458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 860/1740] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:30.229145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:30.231311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:30.237602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.238077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.238536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.239260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.239710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.240130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.264471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:30.269137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-92c9bf62-9669-45e4-beb3-12afa40c2f18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Sep 05 14:46:30.270239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 881/1741] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:30.611733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:30.613857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:30.619717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.620192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.620619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.621294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.621742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.622158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.651259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5fecda9e-d8cd-4ee2-b245-f4da3c7e6d13 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043403 Sep 05 14:46:30.651788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 861/1742] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:30.865312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:30.865851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:30.872115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.872589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.873015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:30.873688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:30.874132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:30.874545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.002082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:31.010291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-922418dd-2298-4d84-a7e4-1eee4b315f03 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149477 Sep 05 14:46:31.010860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 882/1743] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:31.232259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:31.234465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:31.241544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:31.242019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:31.242452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.243167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:31.243627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:31.244046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.272185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1824b827-2b7c-4d0a-95b9-a48216e7cb42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043900 Sep 05 14:46:31.272726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 862/1744] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:31.290281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:31.292511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:31.298914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:31.299392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:31.299824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.300504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:31.300956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:31.302015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.330267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cd77c8f4-2e00-4aff-9cd5-46076180eccb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043933 Sep 05 14:46:31.330839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 883/1745] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:31.664356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:31.666427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:31.672309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:31.672787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:31.673218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.673900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:31.674349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:31.674770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:31.703113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a65e2934-cdc9-4d49-abe6-784422e48247 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043428 Sep 05 14:46:31.703730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 863/1746] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:32.033515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:32.034121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:32.040033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.040503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.040928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.041603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.042048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.042463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.174062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:32.181780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d2267d6-9986-4f2d-aeef-dce56dc44f17 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152171 Sep 05 14:46:32.182336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 884/1747] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:32.284536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:32.286735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:32.293146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.293623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.294055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.294743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.295242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.295665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.324371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c59c757a-86f0-44ba-b159-761b9bd27de8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043856 Sep 05 14:46:32.324910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 864/1748] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:32.342689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:32.344899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:32.351242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.351994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.352420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.353128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.353572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.353987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.383074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ac9c595f-bdb9-4308-abae-a5e36386d923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044710 Sep 05 14:46:32.383614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 885/1749] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:32.716039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:32.718220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:32.724632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.725281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.725718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.726393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:32.727132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:32.727558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:32.757583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a9092721-46fd-4ca0-8afb-a21102ae16b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045491 Sep 05 14:46:32.758133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 865/1750] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:33.205066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:33.205660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:33.212062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.212538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.212962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.213637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.214083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.214499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.235275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:46:33.235429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:46:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:46:33.337638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:33.339844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:33.346213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.346693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.347164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.348480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.348950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.349446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.351907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:33.360236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c860d05-12cf-41cf-b559-fddcad08bdef tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.159134 Sep 05 14:46:33.362971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 886/1751] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:33.379743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ccf3ab2a-9e9e-4b4a-b0b6-e1156d2123d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046135 Sep 05 14:46:33.380468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 866/1752] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:33.395758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:33.397987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:33.403933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.404480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.404920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.405604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.406057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.406531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.437544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cf622238-7204-4d03-b75c-d62bcb42f98d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046191 Sep 05 14:46:33.438089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 887/1753] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:33.777772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:33.780007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:33.785806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.786281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.786711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.787421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:33.787874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:33.788296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:33.815969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c94177b0-7886-47cc-be68-ecce94799471 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042199 Sep 05 14:46:33.817013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 867/1754] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:34.384257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:34.384794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:34.391279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.391759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.392060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:34.392493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.392859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.393301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.393718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.394410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:34.401785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.402298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.402766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.403516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.403980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.404404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.433925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a2686d3c-eda8-4940-9909-6d2ca07fa65b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045980 Sep 05 14:46:34.434551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 868/1755] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:34.453492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:34.455718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:34.462294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.462782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.463249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.465428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.465901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.466335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.499517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c55d9f6c-a040-4afa-8d45-4a5108774394 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049917 Sep 05 14:46:34.500085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 869/1756] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:34.529515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:34.537338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3ac0c6f-17c7-4847-b018-f4f06fb2ddff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.157218 Sep 05 14:46:34.537903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 888/1757] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:34.828637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:34.830817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:34.837121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.837594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.838020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.838701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:34.839175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:34.839593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:34.868429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eb54e862-d488-4062-a764-05d1bc74f192 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Sep 05 14:46:34.868968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 870/1758] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:35.446402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:35.448492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:35.454967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.455445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.455880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.456559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.457010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.457429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.488268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f603e410-7669-4910-87bf-97a97cdfcdb0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045980 Sep 05 14:46:35.488812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 889/1759] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:35.512463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:35.514664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:35.521812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.522293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.522773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.523490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.523946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.524369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.553872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-78f47c4e-16c6-44ef-89e3-cd1ae2a12336 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045447 Sep 05 14:46:35.554597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 871/1760] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:35.560288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:35.560928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:35.566759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.567270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.567698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.568375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.568824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.569242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.698465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:35.706132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6863b5b6-5c69-41e1-b362-b94abf1c4dcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149698 Sep 05 14:46:35.706689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 890/1761] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:35.880768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:35.883480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:35.889374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.889886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.890314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.891024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:35.891473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:35.891894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:35.920725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c647b83-ffc3-40d7-928d-834e57bdda07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043909 Sep 05 14:46:35.921262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 872/1762] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:36.500798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:36.503054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:36.509677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.510151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.510581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.511292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.511739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.512157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.541322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-01d662ac-76c3-40f7-8e31-ad3acc02e809 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044577 Sep 05 14:46:36.541918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 891/1763] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:36.565678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:36.567909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:36.574709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.575215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.575649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.576334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.576787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.577213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.606408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2ac85758-1f3c-4aa8-bce7-56539c2ee21a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044895 Sep 05 14:46:36.606982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 873/1764] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:36.732554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:36.733168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:36.739037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.739507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.739929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.740598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.741042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.741453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.873931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:36.881591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3aefc252-9245-4f96-93dd-52482174148a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152980 Sep 05 14:46:36.882149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 892/1765] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:36.933347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:36.935448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:36.941592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.942073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.942507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.943227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:36.943707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:36.944138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:36.972558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-500bc46a-7a57-4fe7-8198-a66c36855ba2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Sep 05 14:46:36.973098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 874/1766] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:37.554110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:37.556247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:37.562582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.563088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.563520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.564194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.564640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.565055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.593675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4c8d0958-871d-432f-8373-315836079624 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044047 Sep 05 14:46:37.594211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 893/1767] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:37.619367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:37.621563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:37.628079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.628559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.629017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.629703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.630158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.630584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.634885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:37.659770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-54c00b73-e35d-41d2-b2a9-85ce5c6721d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045004 Sep 05 14:46:37.660315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 875/1768] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:37.909004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:37.909539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:37.916193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.916667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.917093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.917767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.918213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.918629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.985813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:37.987979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:37.995532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.996007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.996437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:37.997123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:37.997568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:37.997983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:38.027245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-89c6d7d5-6d14-4979-8984-91c4abc00fcb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045276 Sep 05 14:46:38.027807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 876/1769] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:38.047957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:38.056333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a9720902-40e8-4732-ac52-af5b16cc70ab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155468 Sep 05 14:46:38.056897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 894/1770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:38.607016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:38.609209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:38.615296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:38.615775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:38.616210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:38.616890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:38.617342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:38.617766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:38.647185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2b7259db-0f3d-46d0-ab3f-7d56298ced56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044716 Sep 05 14:46:38.647785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 877/1771] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:38.672997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:38.674630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:38.681152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:38.682287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:38.682721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:38.683422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:38.683867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:38.684283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:38.713051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c9dbf618-4cf8-438c-af24-a44401933963 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044474 Sep 05 14:46:38.713596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 895/1772] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:39.038668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:39.041489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:39.047452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.047932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.048368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.049054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.049504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.049926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.078629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7a47c51b-6fad-4454-88ee-66c636135a1c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043854 Sep 05 14:46:39.079006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:39.079832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 878/1773] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:39.080034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:39.085736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.086237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.086665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.087373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.088323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.088739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.216287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:39.223909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a7d5762-9ad8-4177-b800-60ef790a5839 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148818 Sep 05 14:46:39.224472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 896/1774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:39.660219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:39.662353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:39.669411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.669888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.670321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.671036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.671491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.671913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.700963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1c0ec968-3cb6-4b67-b61d-a746bfc24760 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044871 Sep 05 14:46:39.701512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 879/1775] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:39.725217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:39.727632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:39.734578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.735081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.735537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.736215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:39.736662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:39.737078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:39.765351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9070ae0-82eb-4bc2-a2ae-851580c52c1b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044066 Sep 05 14:46:39.765893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 897/1776] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:40.091593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:40.093787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:40.099669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.100139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.100563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.101243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.101686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.102357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.131250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-644b8e16-60ec-4dbe-8c30-53d638b38977 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Sep 05 14:46:40.131796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 880/1777] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:40.247374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:40.247974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:40.253910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.254395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.254844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.255549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.255996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.256413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.274234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:40.388113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:40.395701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d27276fc-d00c-43df-9ae0-c031ddb56126 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152215 Sep 05 14:46:40.396263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 898/1778] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:40.714046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:40.716214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:40.722676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.723198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.723631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.724313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.724762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.725183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.754285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-51e1ba5a-55e7-413f-b734-b2ff91fcf854 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044775 Sep 05 14:46:40.754847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 881/1779] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:40.777940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:40.780137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:40.786418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.786928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.787358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.788134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:40.788592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:40.789006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:40.818099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8d963cc0-522c-4f0b-ae1c-3667c86cb238 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044615 Sep 05 14:46:40.818634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 899/1780] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:41.143904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:41.146018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:41.152495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.152968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.153395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.154072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.154515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.154969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.183051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4548dd9-33db-4447-840c-8f38f9080236 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043047 Sep 05 14:46:41.183584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 882/1781] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:41.419391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:41.419927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:41.425844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.426322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.426753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.427453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.427900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.428321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.555386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:41.563511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d3e83c40-e129-4534-b4ce-8665d11eac40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148006 Sep 05 14:46:41.564065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 900/1782] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:41.766306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:41.768489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:41.775116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.775600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.776064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.776753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.777206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.777628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.806391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22987202-be6a-474b-9ce3-8b1d14439f5d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044158 Sep 05 14:46:41.807694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 883/1783] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:41.829585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:41.831818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:41.838348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.838925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.839371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.840064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:41.840512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:41.840990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:41.871329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7fb92aa7-0089-4eb5-a9fb-38f7f28333d2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045700 Sep 05 14:46:41.871916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 901/1784] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:42.195701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:42.198513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:42.204369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.204839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.205263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.205937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.206383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.206817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.234863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-876f2baa-ed57-43ee-99a9-b726f8b0449b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043057 Sep 05 14:46:42.235396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 884/1785] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:42.587068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:42.587677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:42.594188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.594670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.595133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.595911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.596366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.596790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.730226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:42.738090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0171261f-edcc-4dc6-8ea1-0a75a138ebe2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155069 Sep 05 14:46:42.738654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 902/1786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:42.819585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:42.821679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:42.828753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.829233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.829669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.830382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.830864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.831298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.859970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c3a1dacf-8173-4d4b-87da-6092d489f2f6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044495 Sep 05 14:46:42.860511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 885/1787] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:42.884064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:42.886946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:42.893231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.893707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.894140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.894847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:42.895301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:42.895749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:42.923825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66786f77-d1fc-47de-9560-b5d2c1f56167 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043680 Sep 05 14:46:42.924364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 903/1788] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:43.247910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:43.250038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:43.255944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.256420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.256846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.257517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.257966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.258377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.285837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cbca4d6e-ba34-4039-b4ef-eef546c2fc43 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Sep 05 14:46:43.286371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 886/1789] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:43.762476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:43.763107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:43.769090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.769576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.770009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.770692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.771173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.771595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.873295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:43.875473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:43.877349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:43.882096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.887601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.887601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.887601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.887601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.888047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.900016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:43.908069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8b3a0d78-6446-4e46-ab8c-12067bd973f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150083 Sep 05 14:46:43.908663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 904/1790] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:43.914215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c5c421b6-8cc4-4a4a-b072-9d651fa7c025 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045533 Sep 05 14:46:43.914757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 887/1791] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:43.936496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:43.938653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:43.944638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.945160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.945606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.946291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:43.946748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:43.947203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:43.975820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6620503c-4a0a-4627-9783-dc4fab22dea5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043805 Sep 05 14:46:43.976358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 905/1792] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:44.297666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:44.299816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:44.305668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.306145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.306603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.307805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.308250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.308667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.336847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c00dabfc-84f1-49d3-ab95-6b0211f6573d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043152 Sep 05 14:46:44.337390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 888/1793] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:44.926453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:44.928674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:44.931984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:44.933133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:44.935708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.936189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.936627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.937316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.937769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.938189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.939408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.939913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.940344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.941019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.941471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.941889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.967318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3357bb69-0dad-42b7-9f8f-867febd3cd1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044965 Sep 05 14:46:44.967903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 906/1794] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:44.988835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:44.991005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:44.996856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.997337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.997774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:44.998488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:44.998975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:44.999397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:45.028875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-04055680-df62-46af-a3db-70fd732df330 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043877 Sep 05 14:46:45.029436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 907/1795] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:45.071016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:45.078766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f8091a06-feb6-47f8-95d7-c459dedd7f1d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150900 Sep 05 14:46:45.079356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 889/1796] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:45.349183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:45.351379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:45.357536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:45.358288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:45.358724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:45.359425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:45.359870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:45.360284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:45.388429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-05e8aba8-77f9-4cef-bbb3-63f016e51638 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043223 Sep 05 14:46:45.388962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 908/1797] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:45.980715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:45.982868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:45.989247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:45.989716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:45.990138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:45.990830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:45.991280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:45.991696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.019363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-85f42290-efc5-451d-8320-87847fa3c295 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043504 Sep 05 14:46:46.019899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 890/1798] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:46.041047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:46.043872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:46.050352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:46.050858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:46.051296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.051978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:46.052431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:46.052853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.082414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b56a624-ec2c-4a55-a090-09ce0cb50a57 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045230 Sep 05 14:46:46.083016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 909/1799] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:46.101315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:46.102179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:46.108187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:46.108655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:46.109077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.109752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:46.110197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:46.110612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.240651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:46.244024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:46.248485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f80de997-1173-4b32-b652-af027f02be3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151050 Sep 05 14:46:46.249043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 891/1800] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:46.400193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:46.402987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:46.408947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:46.409545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:46.409867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.410556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:46.411046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:46.411478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:46.441116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-295aa40a-05aa-4842-a25d-5ee38e3574a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044896 Sep 05 14:46:46.441670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 910/1801] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:47.031889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:47.034016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:47.040748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.041227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.041658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.042335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.043306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.043727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.073228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fa0cf82a-0217-413c-bde8-36299638c287 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045322 Sep 05 14:46:47.073775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 892/1802] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:47.094487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:47.096635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:47.098944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:47.103911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.104384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.104866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.106063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.106511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.106956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.137903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a51b6b84-f43c-40d3-a8db-6d39d5a4ae88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047406 Sep 05 14:46:47.138441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 911/1803] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:47.271422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:47.272061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:47.278529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.279044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.279482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.280167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.280623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.281048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.411519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:47.419060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-92ea0165-6217-482f-85df-2238d628e218 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151515 Sep 05 14:46:47.419616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 893/1804] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:47.454094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:47.456295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:47.462597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.463113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.463548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.464223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:47.464735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:47.465158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:47.493818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7957f676-2c2a-47b4-b734-d7d4b2b53a0f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044221 Sep 05 14:46:47.494348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 912/1805] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:48.085667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:48.087826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:48.089804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:46:48.089949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:46:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments (ip 10.222.0.15) !!! Sep 05 14:46:48.095504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.096004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.096949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.097112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.097559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.097974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.129090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d3084c5c-23be-45e5-b4f7-b4e73b5d1116 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047394 Sep 05 14:46:48.129634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 894/1806] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:48.149451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:48.151644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:48.157999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.158951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.159671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.160552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.190009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-31e97ba4-3b62-43ad-b254-ba258caf7681 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044442 Sep 05 14:46:48.190547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 913/1807] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:48.441776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:48.442299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:48.448169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.448642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.449068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.449742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.450184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.450598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.506127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:48.508286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:48.514169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.514649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.515123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.515793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:48.516241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:48.516658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:48.545742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a2f750d6-6fd0-4635-aeb3-4863911a463c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043590 Sep 05 14:46:48.546565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 914/1808] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:48.585945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:48.593643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a3c8ec61-3039-46b0-8a12-bd19a12661f8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155796 Sep 05 14:46:48.594200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 895/1809] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:49.142194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:49.144347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:49.150350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.150946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.151275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.151947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.152471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.153401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.157446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:49.183205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ac93539d-497c-4467-bcee-244de21923d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044932 Sep 05 14:46:49.183922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 915/1810] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:49.201971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:49.204238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:49.210750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.211265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.211702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.212388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.212843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.213269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.242634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f908880-f883-4876-b0cc-8ca3e1658e8a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045151 Sep 05 14:46:49.243213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 896/1811] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:49.557705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:49.560623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:49.566940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.567418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.567850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.568529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.568979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.569403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.598262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-416ffebd-c480-4c26-8cc4-0be077a6b21c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044628 Sep 05 14:46:49.598828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 916/1812] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:49.617400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:49.618076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:49.624628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.625115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.625553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.626238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:49.626693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:49.627148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:49.756672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:49.764428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-174408b1-8c44-4692-9a14-b22485a09c3b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150955 Sep 05 14:46:49.764992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 897/1813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:50.195860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:50.197984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:50.204953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.205419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.205842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.206514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.206988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.207404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.236005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7eb9523-d0f9-4455-b363-6ab1e274eb9f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044115 Sep 05 14:46:50.236545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 917/1814] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:50.254939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:50.257131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:50.263637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.264113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.264553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.265242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.265693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.266117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.295074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-63a77d54-4e9c-4a63-a9a4-54980006c17b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Sep 05 14:46:50.295621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 898/1815] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:50.611442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:50.613564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:50.619435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.619909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.620338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.621016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.621459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.621872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.649431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-da11233c-6f29-4e5d-b4cf-f55b9b2b3028 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041983 Sep 05 14:46:50.649955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 918/1816] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:50.788083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:50.788737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:50.795357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.795838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.796272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.796962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:50.797415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:50.797840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:50.928176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:50.935953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9174288a-e67a-4981-aaaa-78d8f147965d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151741 Sep 05 14:46:50.936519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 899/1817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:51.248853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:51.251030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:51.257409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.257883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.258317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.259032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.259483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.259903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.289277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7de17f05-fcf4-43ae-a7bc-5817aa51abdc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044818 Sep 05 14:46:51.289816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 919/1818] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:51.307620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:51.310310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:51.316654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.317128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.317557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.318237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.318685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.319132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.348370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e5572a22-3152-4749-b920-67e55c220e03 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Sep 05 14:46:51.348917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 900/1819] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:51.662466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:51.664547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:51.671067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.671543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.671971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.672647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.673092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.673515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.701953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dde6fee2-a575-4cce-92d7-10905e35cf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 Sep 05 14:46:51.702487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 920/1820] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:51.959145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:51.959670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:51.966182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.966653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.967113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:51.967785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:51.968233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:51.968646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.098489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:52.107338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dae0307d-7d12-447f-bf40-1cd89314ea22 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152099 Sep 05 14:46:52.107902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 901/1821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:52.301715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:52.303877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:52.310678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:52.311187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:52.311616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.312297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:52.312747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:52.313168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.342030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6371aed4-e6d7-4611-9a51-abf5c74f56e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044296 Sep 05 14:46:52.342573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 921/1822] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:52.361054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:52.363355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:52.369894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:52.370406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:52.370875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.372062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:52.372525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:52.372950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.402828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-85c7053d-4f9d-4093-9d85-3bf0d6165618 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045707 Sep 05 14:46:52.403388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 902/1823] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:52.714072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:52.716281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:52.722174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:52.722658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:52.723127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.723807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:52.724259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:52.724675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:52.754038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-20beb0cd-2739-430a-a3f8-b282b871c049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043950 Sep 05 14:46:52.754585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 922/1824] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:53.130561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:53.131225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:53.137166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.137644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.138109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.138819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.139265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.139685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.268947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:53.276470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-74958e4e-2ce0-450c-91d4-2f07c79da5f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149761 Sep 05 14:46:53.277019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 903/1825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:53.354873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:53.357025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:53.363538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.364043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.364470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.365151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.365599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.366014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.395385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0ff1a010-95ae-46c2-abdd-40710347c648 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045217 Sep 05 14:46:53.395932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 923/1826] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:53.415010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:53.417139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:53.423551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.424026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.424454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.425133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.425579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.426006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.456506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4aba29f4-0635-461c-b323-2a0540ba97ee tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045397 Sep 05 14:46:53.457059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 904/1827] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:53.767000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:53.769161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:53.775110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.775591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.776024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.776707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:53.777159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:53.777584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:53.805501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cf061deb-0a0f-49aa-8ee6-ed0bdecb7ef3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042491 Sep 05 14:46:53.806050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 924/1828] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:54.299067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:54.299602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:54.305485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.305962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.306395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.307102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.307556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.307973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.407872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:54.410117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:54.416458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.416939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.417373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.418061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.418516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.418965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.441567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:54.448438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-818062d0-47a0-4615-aa41-1aefe887cbbf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044464 Sep 05 14:46:54.449006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 925/1829] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:46:54.449851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb3c713d-6ee3-42e9-b031-17b195326f6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154152 Sep 05 14:46:54.450638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 905/1830] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:54.469143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:54.471390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:54.477475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.477958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.478389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.479104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.479561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.479983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.509157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d6d9995e-9f13-4fb1-b4cf-35707d3ed353 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Sep 05 14:46:54.509710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 926/1831] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:54.817586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:54.819765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:54.825819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.826295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.826748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.827463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:54.827907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:54.828321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:54.857180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-70a0cc38-c114-44f4-950a-68601508b86f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043570 Sep 05 14:46:54.857653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 906/1832] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:55.461175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:55.463322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:55.469823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.470294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.470718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.471424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.471867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.472280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.472701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:55.473318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:55.480976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.481454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.481891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.482580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.483068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.483493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.503370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-516a92f2-60bc-4afe-a589-1ab2511c835f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046076 Sep 05 14:46:55.504287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 927/1833] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:55.521288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:55.523436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:55.529313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.529792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.530223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.530953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.531401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.531818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.561158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c2e5536-5906-4eb2-a9f6-c2f73b610a7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043605 Sep 05 14:46:55.561910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 928/1834] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:55.613730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:55.622158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8520cb45-7450-4d8a-9a9a-92e6e16791c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153391 Sep 05 14:46:55.622719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 907/1835] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:46:55.869129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:55.871464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:55.877307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.877785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.878213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.878915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:55.879360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:55.879774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:55.907871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ac000c5-5c63-4171-b338-cdfcd472114a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042743 Sep 05 14:46:55.908394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 929/1836] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:56.515560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:56.517999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:56.524352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.524821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.525249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.525922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.526365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.526800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.543321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:56.556181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-855bd9b7-d581-4e42-bffa-c421b707a0d4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044647 Sep 05 14:46:56.556716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 908/1837] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:56.573054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:56.575266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:56.581804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.582283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.582717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.583444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.583900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.584353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.614090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-af480dd8-2df4-417e-8787-f190c444f2d5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045047 Sep 05 14:46:56.614640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 930/1838] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:56.644496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:56.645107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:56.651161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.651643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.652079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.652761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.653708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.654126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.784462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:56.792273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fd0ef162-bec7-4c0e-a99c-8a8147bfd6cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152023 Sep 05 14:46:56.794974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 909/1839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:56.920761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:56.922926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:56.928697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.929169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.929593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.930265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:56.930711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:56.931150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:56.957798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:46:56.962320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-740e15c6-84fb-4f1f-af77-7f0a64f5f833 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046183 Sep 05 14:46:56.962883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 931/1840] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:57.568980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:57.571145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:57.578135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.578612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.579075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.579759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.580214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.580632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.610159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-69bb35c2-c3a6-45e7-9c7e-e2da61b466e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045309 Sep 05 14:46:57.610632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 910/1841] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:57.626125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:57.628388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:57.635102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.635583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.636015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.636732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.637183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.637604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.665625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-30fb3803-b15e-473e-9c8a-f2a632dda674 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Sep 05 14:46:57.666162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 932/1842] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:57.816552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:57.817151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:57.823080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.823562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.823988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.824659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.825105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.825521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.951856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:57.959476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb3f257d-269d-43b0-b44d-729f71bc65c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.146807 Sep 05 14:46:57.960034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 911/1843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:57.975026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:57.977456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:57.983861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.984342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.984773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:57.985452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:57.985901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:57.986320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:58.015199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e65f8dea-8ac6-457c-ad96-333d41eecfc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044039 Sep 05 14:46:58.015744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 933/1844] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:58.622416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:58.625191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:58.631691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:58.632163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:58.632588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:58.633272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:58.633715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:58.634131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:58.663542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1b5ddc14-e7d7-4a7e-8f18-6d718cb35970 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045105 Sep 05 14:46:58.664084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 912/1845] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:58.677579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:58.679746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:58.686155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:58.686636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:58.687113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:58.687803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:58.688253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:58.688674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:58.718612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d6ff491-0446-4ac6-bf65-af0fe676c7b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045078 Sep 05 14:46:58.719202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 934/1846] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:46:58.981556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:58.982165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:58.988040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:58.988512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:58.988937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:58.989610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:58.990053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:58.990468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.027700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:59.029832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:59.035692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:59.036170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:59.036601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.037287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:59.037731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:59.038183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.067615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-19092a07-6792-439f-9297-a43924817b9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043722 Sep 05 14:46:59.068182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 935/1847] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:46:59.119979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:46:59.132623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-355bcbd4-4aa1-418e-b544-9386c805844b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154860 Sep 05 14:46:59.133183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 913/1848] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:46:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:46:59.676705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:59.678877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:59.685323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:59.685798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:59.686270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.686977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:59.687431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:59.687859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.716280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c8370c31-5354-4171-a2d8-ad39866f942b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043543 Sep 05 14:46:59.716761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 936/1849] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:46:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:46:59.731276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:46:59.734096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:46:59.740521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:59.740993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:59.741421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.742101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:46:59.742546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:46:59.742992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:46:59.770924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-742bf3a3-1619-41ee-9656-8d83a7bf0799 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Sep 05 14:46:59.771453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 914/1850] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:46:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:00.080369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:00.082508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:00.088426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.088940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.089376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.090060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.090511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.090964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.119821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2a868ec8-0367-42c7-ac2d-caf0ab8f19e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044047 Sep 05 14:47:00.120365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 937/1851] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:00.158191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:00.159205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:00.166171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.166716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.167238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.168159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.168819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.169356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.306039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:00.314163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cd67d310-7e11-4b35-bf9d-75d82368747b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.161789 Sep 05 14:47:00.314721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 915/1852] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:00.729683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:00.731866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:00.738703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.739208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.739636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.740313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.740761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.741178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.769884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee5d7828-773d-4d08-88ec-0d656bccc8d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044524 Sep 05 14:47:00.770422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 938/1853] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:00.782706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:00.784880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:00.791163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.791639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.792070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.792748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:00.793193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:00.793611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:00.822835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-863f21d1-81c9-4a1c-8ae2-c380f27bd02b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044246 Sep 05 14:47:00.823369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 916/1854] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:01.132472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:01.134653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:01.140696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.141177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.141616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.142301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.142754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.143226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.173001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3d537ab-31b4-4075-8f61-ae17da40359a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044605 Sep 05 14:47:01.173549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 939/1855] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:01.337235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:01.337834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:01.343684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.344156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.344581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.345252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.345695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.346109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.478074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:01.486282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b39a2956-5024-433b-9a79-54f6b9020550 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152887 Sep 05 14:47:01.486861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 917/1856] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:01.782701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:01.784866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:01.791310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.791785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.792218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.792900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.793350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.793770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.823042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cb816d07-5327-431e-b57f-2869e53a2180 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044759 Sep 05 14:47:01.823595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 940/1857] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:01.835035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:01.837180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:01.843678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.845065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.845065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.845298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:01.845709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:01.846626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:01.876207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18e461d9-cae9-4b48-ad9e-cd0a4ba4f478 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045162 Sep 05 14:47:01.879422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 918/1858] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:02.185578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:02.187754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:02.193623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.194107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.194541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.195259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.195715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.196139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.225048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2c4295a-1929-4ed3-ae6f-d32a3daee52d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 Sep 05 14:47:02.225591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 941/1859] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:02.510204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:02.510880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:02.516753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.517225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.517646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.518938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.519386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.519803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.652389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:02.659965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a254b098-b72c-416f-9009-7ebc1ff7ae12 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153668 Sep 05 14:47:02.660524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 919/1860] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:02.835688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:02.837755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:02.844153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.844630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.845061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.845744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.846195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.846615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.875637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07b27a49-2b07-463b-8c95-007338dd04e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044085 Sep 05 14:47:02.876182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 942/1861] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:02.888443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:02.890594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:02.896941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.897412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.897836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.898510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:02.898991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:02.899411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:02.928100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6cdfd509-b47b-4580-95d5-e3286174f763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043584 Sep 05 14:47:02.928631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 920/1862] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:03.238267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:03.240486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:03.246320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.246814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.247259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.247942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.248397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.248817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.276349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5094733d-9310-42d1-b4f8-a7db8ed14b68 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042698 Sep 05 14:47:03.276883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 943/1863] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:03.682944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:03.683550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:03.689466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.689935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.690363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.691073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.691516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.691929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.819189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:03.826864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55133b5b-8710-4eb1-b5ca-d25e887dedb5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147814 Sep 05 14:47:03.827431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 921/1864] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:03.888805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:03.890985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:03.897827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.898305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.898737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.899448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.899902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.900330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.929153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9b780e20-b470-4d70-af93-5a0b211d2487 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044442 Sep 05 14:47:03.929698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 944/1865] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:03.940753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:03.942927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:03.949390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.949873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.950309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.951048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:03.951505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:03.951926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:03.980998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b0a06111-2353-41d8-a3de-14879e925312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044729 Sep 05 14:47:03.981538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 922/1866] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:04.288520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:04.290681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:04.296569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:04.297046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:04.297475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:04.298152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:04.298598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:04.299050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:04.328472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7f8c70e1-df01-4291-837a-eb7f91166745 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Sep 05 14:47:04.329025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 945/1867] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:04.850057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:04.850664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:04.856855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:04.857333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:04.857763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:04.858442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:04.858918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:04.859341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:04.942081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:04.944177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:04.950470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:04.950995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:04.951423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:04.952102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:04.952556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:04.952973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:04.982929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3d02a8e9-d140-415b-86ee-062633677b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045289 Sep 05 14:47:04.983681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 946/1868] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:04.989771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:04.993321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:04.995481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:04.997862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-68ebf02e-2f1f-45de-9cd9-3488eee277ae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151693 Sep 05 14:47:04.998431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 923/1869] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:05.001432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:05.001915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:05.002353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:05.003605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:05.004060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:05.004484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:05.034555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4eeaa953-15dd-4bfb-8bec-f2b0700573c7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044990 Sep 05 14:47:05.035137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 947/1870] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:05.340962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:05.343116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:05.349551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:05.350022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:05.350452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:05.351162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:05.351613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:05.352024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:05.380762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-baed29d5-7053-4c1f-bbd0-24631239cc78 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043738 Sep 05 14:47:05.381332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 924/1871] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:05.996068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:05.998184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:06.005247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.005721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.006147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.006849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.007296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.007712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.021670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:06.022276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:06.024841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:06.028595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.029070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.029498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.030288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.030680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.031122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.035688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:06.040702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-85501d06-b8e8-49a0-b869-7e09ee1eb148 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046474 Sep 05 14:47:06.040702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 948/1872] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:06.047987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:06.050145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:06.055945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.056428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.056863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.057554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.058008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.058425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.089113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f72a7505-2ac1-4b52-a591-7df9f4538909 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 Sep 05 14:47:06.089912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 949/1873] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:06.164835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:06.172497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-300b0626-9f22-412c-90b4-e5276a7a851e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155209 Sep 05 14:47:06.173057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 925/1874] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:06.392178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:06.394380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:06.400422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.400906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.401341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.402054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:06.402506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:06.402971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:06.433987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-09bb1d1a-c5ae-45ba-8ffa-11cf462a866d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045750 Sep 05 14:47:06.434542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 950/1875] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:07.052326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:07.054499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:07.060868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.061345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.061776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.062463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.062940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.063365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.093280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5176e200-426f-49a0-8e59-2701dbe5a9ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045630 Sep 05 14:47:07.093839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 926/1876] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:07.101913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:07.104339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:07.110742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.111320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.111758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.113090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.113542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.113965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.141860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-af2777aa-9fdb-45b2-a699-b93252c21f8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043852 Sep 05 14:47:07.142406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 951/1877] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:07.195682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:07.196294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:07.202184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.202665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.203142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.203845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.204284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.204710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.331454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:07.339167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4ec0a8c0-e3c7-419c-b3ea-28168beeb18b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147304 Sep 05 14:47:07.339735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 927/1878] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:07.446420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:07.448658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:07.454672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.455188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.455615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.456647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:07.457097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:07.457513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:07.485509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-be9b91d3-a4d3-4c0b-aef0-7b7a2af9e50e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043183 Sep 05 14:47:07.486048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 952/1879] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:08.105919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:08.108098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:08.114543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.115064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.115500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.116222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.116673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.117101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.145955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d12b6228-4c1c-48aa-92e1-72c72d180f6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044322 Sep 05 14:47:08.146488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 928/1880] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:08.153539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:08.156366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:08.163380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.163856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.164287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.164962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.165409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.165827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.194479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-29e484e8-74fd-4f7a-9215-58b6e41cf482 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044859 Sep 05 14:47:08.195076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 953/1881] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:08.361490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:08.362117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:08.368054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.368542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.368976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.369661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.370112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.370535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.497694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:08.500010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:08.501750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:08.506377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.506911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.507334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.508030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:08.508480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:08.508902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:08.510007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9e573d36-f57b-4b7a-b846-9a9dedb6f207 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152433 Sep 05 14:47:08.510576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 929/1882] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:08.537916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-37e70d5d-2ac7-4cf6-835e-4b48664cd56f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044280 Sep 05 14:47:08.538469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 954/1883] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:09.158727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:09.161397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:09.167807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.168283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.168714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.169394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.169843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.170260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.199282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b900d5d5-e3bb-49e3-bc4f-a51a57cb94ce tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044526 Sep 05 14:47:09.199826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 930/1884] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:09.206843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:09.209016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:09.215418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.215898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.216332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.217016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.217468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.217894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.247349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cebb47ee-386c-4af1-ae3e-5a3543e706f0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044506 Sep 05 14:47:09.247887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 955/1885] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:09.534928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:09.535543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:09.541437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.541916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.542350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.543065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.543517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.543942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.549263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:09.551441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:09.557634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.558121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.558551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.559253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:09.559699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:09.560116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:09.590177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88b3b8b1-1f6b-4269-a787-cd72fb58dbec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Sep 05 14:47:09.590752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 956/1886] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:09.672362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:09.680658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8ab5ef8f-e9c4-4e93-9c9a-d0d9d6e7db81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150230 Sep 05 14:47:09.681219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 931/1887] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:10.211482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:10.213636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:10.220121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.220592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.221022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.222490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.223228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.223682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.252555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3646779f-0ba6-47cd-9768-ca319d8b71e6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045056 Sep 05 14:47:10.253095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 957/1888] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:10.259602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:10.261782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:10.268817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.269299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.269738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.270425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.270905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.271335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.300621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f1d4653-39e3-4980-9273-0583b402f4ed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045058 Sep 05 14:47:10.301164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 932/1889] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:10.602686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:10.604876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:10.610710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.611212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.611643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.612315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.612758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.613172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.640754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6b02054f-2b6e-4996-9c23-b93abfd8b347 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042347 Sep 05 14:47:10.641291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 958/1890] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:10.703523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:10.704127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:10.710602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.711107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.711536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.712211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:10.712721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:10.713132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:10.855787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:10.863691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bc71ba05-a145-4366-90ce-3b438f19bbb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.164054 Sep 05 14:47:10.864617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 933/1891] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:11.265670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:11.267866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:11.274309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.274803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.275274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.275957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.276411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.276833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.305959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fb67d6d3-805f-471e-9241-56950f6a642f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044343 Sep 05 14:47:11.306497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 959/1892] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:11.312913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:11.315744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:11.322016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.322518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.322984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.323658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.324103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.324516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.352992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-40f478a0-01dc-4b2e-8eee-4c89a5f0bd3a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043807 Sep 05 14:47:11.353535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 934/1893] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:11.653661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:11.655863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:11.661741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.662224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.662665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.663383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.663837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.664272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.693097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2e1ae2ea-01ab-49ac-a556-dda9c14ae159 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043535 Sep 05 14:47:11.693642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 960/1894] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:11.886713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:11.887365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:11.893504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.893983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.894415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:11.895129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:11.895585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:11.896007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.023457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:12.031101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f11eaf58-5c0b-4019-92f8-e6416cca0475 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148236 Sep 05 14:47:12.031663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 935/1895] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:12.318288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:12.320393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:12.322657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:12.327334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:12.327808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:12.328237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.334137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:12.334137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:12.334137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.360374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f425602-f825-4cf5-98bb-a7608609a532 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046782 Sep 05 14:47:12.360919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 961/1896] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:12.365254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:12.367464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:12.373786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:12.374266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:12.374701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.375415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:12.375866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:12.376287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.406024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0923c83e-374d-48a7-8d6c-cc0437438fc8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044704 Sep 05 14:47:12.406576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 936/1897] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:12.706148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:12.708453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:12.714295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:12.714771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:12.715232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.715915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:12.716365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:12.716789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:12.746411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d108f888-8627-4d6a-96ce-14006c538406 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044818 Sep 05 14:47:12.746990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 962/1898] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:13.054159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:13.054770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:13.056653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:13.061469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.061950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.062382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.063096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.063551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.063976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.201909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:13.210047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-93ecb3ac-5802-4595-99da-6dad07de25f2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.159854 Sep 05 14:47:13.210607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 937/1899] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:13.372865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:13.374946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:13.381902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.382372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.385758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.385758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.385758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.385758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.412755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06b236bd-2f56-47c9-884e-9c48c8529e9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043920 Sep 05 14:47:13.413299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 963/1900] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:13.417735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:13.419929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:13.426846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.427325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.427781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.428459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.428958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.429380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.460278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3d15320a-744a-4276-b426-48fe7459e916 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046488 Sep 05 14:47:13.460847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 938/1901] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:13.759220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:13.761353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:13.767240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.767713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.768173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.769367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:13.769811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:13.770230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:13.798028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f91d1f4-4aae-4ad0-aeb5-80861b29f749 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Sep 05 14:47:13.798566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 964/1902] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:14.233105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:14.233748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:14.239742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.240220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.240651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.241332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.241781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.242200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.372997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:14.381143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-122fb429-f817-43a5-ab72-566b009aa1d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152081 Sep 05 14:47:14.381694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 939/1903] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:14.426051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:14.428230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:14.434521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.435035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.435468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.436143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.436581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.436995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.440571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:14.465447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ffb431d-3d90-431b-9479-694e6f08f995 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044116 Sep 05 14:47:14.466203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 965/1904] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:14.473039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:14.475198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:14.481276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.481749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.482180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.482882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.483332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.483751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.512437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0c339f1-323b-4722-a181-9876fb1863f1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043792 Sep 05 14:47:14.512967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 940/1905] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:14.809341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:14.811533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:14.818498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.819013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.819442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.820121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:14.820569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:14.820989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:14.848749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-97b9c525-2ffd-43e1-943c-c424220932aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043397 Sep 05 14:47:14.849291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 966/1906] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:15.404013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:15.404556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:15.411051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.411525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.411992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.412681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.413161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.413587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.477938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:15.480149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:15.486420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.486931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.487364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.488043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.488486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.488906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.519627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f759be1c-238d-45cd-aa46-b336cf5e4c0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045619 Sep 05 14:47:15.519932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 967/1907] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:15.524515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:15.526640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:15.532374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.532846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.533280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.533976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.534426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.534878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.543262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:15.546635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:15.551703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-45de0f9e-c09f-494e-8933-c35c11846fb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151679 Sep 05 14:47:15.552270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 941/1908] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:15.564553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cc7f3246-e88f-4414-9a4b-8139f3708e2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043617 Sep 05 14:47:15.565670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 968/1909] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:15.862535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:15.864724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:15.870652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.871162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.871595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.872274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:15.872725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:15.873148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:15.901775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2d9c27bf-3114-48e1-aa02-2a25f1c42cc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044184 Sep 05 14:47:15.902321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 942/1910] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:16.531833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:16.533944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:16.540047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.540520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.540948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.541622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.542065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.542479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.571660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c9362fda-8bb2-47a7-8280-25ea2a391b54 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043718 Sep 05 14:47:16.572133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 969/1911] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:16.575368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:16.576016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:16.578467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:16.580611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:16.582715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.583266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.583694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.584376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.584827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.585244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.586369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.586878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.587367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.588230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.588688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.589109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.618359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c49312b5-667b-432c-a58d-f2b59655df0e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043559 Sep 05 14:47:16.618933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 970/1912] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:16.717450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:16.725723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e9521de7-e1d1-429b-8ed5-27c043643ec5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154290 Sep 05 14:47:16.726284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 943/1913] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:16.914077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:16.916288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:16.922080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.922545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.923021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.923699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:16.924173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:16.925198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:16.953348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a4467e8-8f68-4c9b-9fa7-05848b5647e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043297 Sep 05 14:47:16.953889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 971/1914] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:17.584191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:17.586362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:17.592876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.593352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.593780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.594460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.594945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.595370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.625040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a07f4736-4dd5-44f8-a467-8e1e52edab71 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044963 Sep 05 14:47:17.625865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 944/1915] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:17.630818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:17.633108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:17.639515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.639987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.640416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.641088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.641532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.641949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.670668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d362ea0b-ac1f-4d49-9d8f-701e5e4ef54a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043811 Sep 05 14:47:17.671243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 972/1916] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:17.749173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:17.749819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:17.755750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.756227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.756657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.757341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.757791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.758213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.887721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:17.896087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24a49433-5f84-4332-a28b-489e2483a6ff tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150763 Sep 05 14:47:17.896642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 945/1917] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:17.965468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:17.967624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:17.974132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.974605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.975062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:17.975737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:17.976183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:17.976597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:18.004379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bea4d362-2110-4a7f-9a3c-4f545f22082c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042866 Sep 05 14:47:18.004908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 973/1918] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:18.637656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:18.639848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:18.646233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:18.646706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:18.647168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:18.647850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:18.648297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:18.648715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:18.677646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-796f69c3-f2ff-4960-9076-374fb319eeae tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043952 Sep 05 14:47:18.678300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 946/1919] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:18.683570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:18.685754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:18.692722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:18.693196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:18.693626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:18.694307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:18.694752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:18.695191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:18.723343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-89428fc2-f32e-4a5f-a761-3a4223977031 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043679 Sep 05 14:47:18.723889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 974/1920] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:18.920226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:18.920764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:18.927415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:18.927899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:18.928327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:18.929008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:18.929458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:18.929877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.016611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:19.018890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:19.024740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:19.025218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:19.025651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.026326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:19.026773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:19.027211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.056507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4f6dcd0f-57e0-4d83-951a-d566cf26a545 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043826 Sep 05 14:47:19.057068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 975/1921] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:19.060540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:19.068413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-deb79d35-87ae-4e78-8fd7-d170ee55765a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152150 Sep 05 14:47:19.068965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 947/1922] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:19.690339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:19.692536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:19.698963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:19.699431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:19.699853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.700524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:19.700967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:19.701386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.730382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ef01a22-908f-4243-850d-4345c3aaff56 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044066 Sep 05 14:47:19.730953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 976/1923] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:19.735654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:19.738431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:19.744827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:19.745305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:19.745738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.746426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:19.746925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:19.747374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:19.777104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fe931408-e621-4efa-9dc3-9e0c348a0dde tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045395 Sep 05 14:47:19.777642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 948/1924] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:20.069391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:20.071559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:20.077512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.077986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.078418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.079162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.079608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.080027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.090538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:20.091182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:20.097144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.097623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.098051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.098741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.099280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.099698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.109801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6df7c982-5e4a-4841-8be5-6f805b2adf54 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044901 Sep 05 14:47:20.110370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 977/1925] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:20.227704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:20.235342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3dcea93f-1ccc-4c3f-8bd4-85971e197e92 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148725 Sep 05 14:47:20.235899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 949/1926] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:20.743398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:20.745526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:20.751958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.752479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.752909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.753591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.754039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.754456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.783225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-353156c8-d44e-4fcb-bb36-60a002264466 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043808 Sep 05 14:47:20.784425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 978/1927] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:20.790037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:20.792257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:20.798700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.799215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.799646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.800326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:20.800776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:20.801195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:20.829459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-65b1f8b6-0e75-4e87-9daf-97540a3b2aba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043508 Sep 05 14:47:20.829999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 950/1928] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:21.122261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:21.124451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:21.130380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.130895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.131333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.132018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.132465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.132885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.162403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cea308b9-b832-41f3-8b2e-5cdd7f69aa9a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Sep 05 14:47:21.163023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 979/1929] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:21.259033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:21.259633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:21.265434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.265904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.266337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.267035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.267483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.267896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.394613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:21.402231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bed7d2e8-d702-425b-8bf0-a1162856627f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147027 Sep 05 14:47:21.402777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 951/1930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:21.796357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:21.798455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:21.805374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.805850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.806315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.807023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.807472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.807888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.836813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1262107a-3806-48ac-9ee6-ae433f3f9887 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044514 Sep 05 14:47:21.837365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 980/1931] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:21.843016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:21.845193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:21.851562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.852037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.852471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.853409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:21.853858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:21.854279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:21.884442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80c9a4c5-aac1-461c-bdb7-24575016314c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045714 Sep 05 14:47:21.885044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 952/1932] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:22.174196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:22.176936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:22.182884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.183362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.183787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.184462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.184908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.185323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.208757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:22.213257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-49c69f78-c309-4517-a161-0652355afcf6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043100 Sep 05 14:47:22.213803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 981/1933] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:22.425869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:22.426399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:22.432450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.432962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.433443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.434210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.434709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.435239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.570431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:22.578065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4e4de73-06bd-4bdd-9768-7dbf4859d491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156562 Sep 05 14:47:22.578614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 953/1934] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:22.850884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:22.853307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:22.860113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.860590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.861025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.861751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.862282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.862706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.891386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-03ce488d-11fc-428e-abcd-f67398e4f79b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044515 Sep 05 14:47:22.891932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 982/1935] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:22.897784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:22.899969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:22.906294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.906766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.907223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.907897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:22.908349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:22.908768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:22.937096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c175cea4-3316-4ac8-bbc8-75d15e84776b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043934 Sep 05 14:47:22.937627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 954/1936] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:23.224729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:23.226900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:23.233041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.233520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.233952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.234635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.235112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.235536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.265566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-80163536-d440-4e24-90a6-21c0fb424b48 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044824 Sep 05 14:47:23.266117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 983/1937] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:23.602340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:23.603255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:23.609197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.609683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.610131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.610844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.611303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.612328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.741244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:23.748863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5fe5c962-4d18-4622-8ef4-1ccdfefbfcf9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150506 Sep 05 14:47:23.749420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 955/1938] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:23.904229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:23.906383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:23.913303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.913775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.914202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.914910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.915356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.915771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.943844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-daf1b80f-baf7-49ed-89d1-255e2941448f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043508 Sep 05 14:47:23.944531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 984/1939] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:23.949596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:23.951786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:23.958635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.959154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.959589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.960271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:23.960717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:23.961136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:23.990187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-940413c4-13dd-487d-9989-69de4dbc59ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Sep 05 14:47:23.990729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 956/1940] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:24.278033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:24.280218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:24.286024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:24.286501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:24.286971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:24.287657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:24.288110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:24.288533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:24.317992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eff36a15-b55f-4e17-aa5f-1848c1978d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043917 Sep 05 14:47:24.318562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 985/1941] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:24.771634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:24.772358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:24.778297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:24.778887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:24.779320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:24.780024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:24.780466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:24.780881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:24.955891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:24.958086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:24.964564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:24.965054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:24.965491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:24.966188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:24.966639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:24.967094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:24.974267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:24.982904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9acd88dd-61b1-4c9c-b97a-3ccd45303510 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.215157 Sep 05 14:47:24.983479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 957/1942] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:24 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:24.998239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f7eec48a-8539-4f6b-aaaa-98f4b7dc6324 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046442 Sep 05 14:47:25.001397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:25.002937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 986/1943] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:25.003593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:25.009386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:25.009854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:25.010289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:25.010989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:25.011435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:25.011850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:25.028019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:25.040927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e03b14f0-cd5c-4e88-8147-ca6bcbc2d6c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043459 Sep 05 14:47:25.041465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 958/1944] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:25.330383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:25.333141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:25.339038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:25.339543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:25.339976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:25.340653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:25.341101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:25.341530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:25.371087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5124fca8-d12d-4cc6-8c4d-4749aacae7d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044699 Sep 05 14:47:25.371639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 987/1945] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:26.006938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:26.007660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:26.009531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:26.011683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:26.014065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.014540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.014998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.015681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.016128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.016552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.018519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.019030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.019459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.020138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.020620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.021400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.052463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-408cbcc1-9be7-4be6-9869-dc1b61a86602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046745 Sep 05 14:47:26.053029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 988/1946] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:26.057557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:26.059724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:26.065453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.065928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.066358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.067086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.067536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.067954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.099569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bb066757-5538-4a5a-9c61-af8798c0bd47 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045518 Sep 05 14:47:26.100140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 989/1947] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:26.145892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:26.153542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b87bcce2-5f8e-4489-bebc-7c2ce205eb4f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150912 Sep 05 14:47:26.154099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 959/1948] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:26.382757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:26.384856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:26.390842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.391319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.397550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.397550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:26.397550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:26.397550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:26.423050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1c91d1b-c78d-413f-ac49-1526466a6747 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Sep 05 14:47:26.423603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 990/1949] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:27.065714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:27.067900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:27.074813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.075298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.075733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.076415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.076859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.077279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.107428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-81075da9-16a4-4652-b763-de29c7a1b64a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046277 Sep 05 14:47:27.107974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 960/1950] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:27.112787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:27.115018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:27.121405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.121882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.122312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.123096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.123552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.123972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.152956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1af381c2-1427-4bf1-ae14-2b254ea67627 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044803 Sep 05 14:47:27.153493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 991/1951] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:27.177557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:27.178163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:27.184105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.184578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.185003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.185671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.186113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.186528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.316578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:27.324085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bd850955-c047-4ba7-92ed-0b672dca847e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151127 Sep 05 14:47:27.324649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 961/1952] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:27.435235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:27.437399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:27.443852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.444346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.444765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.445451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:27.445900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:27.446323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:27.474794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c346f66a-6e7d-4b28-b8a3-71fede3afe59 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043471 Sep 05 14:47:27.475360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 992/1953] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:28.120616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:28.122762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:28.129267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.129753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.130192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.130934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.131391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.131815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.161398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-46a56933-ef66-4676-b2cb-54d91944d48a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044854 Sep 05 14:47:28.161946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 962/1954] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:28.165750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:28.167942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:28.173968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.175097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.175525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.176200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.176644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.177090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.205626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-85c8668e-5d54-4f97-8ed1-7a7af54be1c6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043809 Sep 05 14:47:28.206165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 993/1955] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:28.347419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:28.347940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:28.354058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.354533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.354990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.355665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.356115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.356534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.483156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:28.487916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:28.490081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:28.491390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-62ff0bf6-9988-40c0-a696-8d08a876c9b7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148034 Sep 05 14:47:28.491947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 963/1956] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:28.496012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.496493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.496930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.497620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:28.498071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:28.498500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:28.527565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-221b0795-ff22-41bb-afa3-adff58867928 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044059 Sep 05 14:47:28.528102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 994/1957] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:29.173907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:29.176216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:29.182546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.183048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.183478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.184162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.184607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.185020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.214164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d54af80f-b3ef-42d8-84d7-09bf74704f16 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044244 Sep 05 14:47:29.214706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 964/1958] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:29.217732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:29.219928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:29.226973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.227456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.228143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.228829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.229286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.229711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.258743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3239af04-0baf-4cdb-bacb-e1a830e8c5a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045176 Sep 05 14:47:29.259330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 995/1959] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:29.515041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:29.515648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:29.522133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.522636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.523101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.523777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.524221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.524637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.539724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:29.541859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:29.547731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.548210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.548640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.549326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:29.549775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:29.550204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:29.579407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5be3afd4-3a32-4958-aeb5-a25849ddaaff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043509 Sep 05 14:47:29.579971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 996/1960] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:29.872954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:29.881017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f0b2072b-023e-4f64-ad5b-c3ebccb17e8e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.369843 Sep 05 14:47:29.881581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 965/1961] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:30.226797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:30.229230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:30.235539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.236011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.236437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.237118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.237560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.237972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.266695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-94ecd9e5-d7b9-44aa-b7fe-ba8a8085cb69 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043893 Sep 05 14:47:30.267335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 997/1962] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:30.271654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:30.273819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:30.280166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.280647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.281102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.281803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.282255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.282677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.311646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ea249666-6840-41cf-b9e1-db6b3f9d80e5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044512 Sep 05 14:47:30.312197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 966/1963] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:30.592471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:30.594530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:30.601025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.601506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.601941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.602626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.603368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.603793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.620559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:30.634018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dbefcadb-03d8-460d-bd63-a2c248331549 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045560 Sep 05 14:47:30.634719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 998/1964] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:30.904139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:30.904663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:30.911601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.912224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.912581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:30.913333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:30.913796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:30.914279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.043776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:31.052098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-82faf511-1d4f-4574-8da4-015992c3af26 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152042 Sep 05 14:47:31.052662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 967/1965] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:31.280318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:31.282460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:31.289678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:31.290161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:31.290599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.291320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:31.291779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:31.292206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.320746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-86797eba-d072-4002-a4d9-7c6109d1dfcc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044748 Sep 05 14:47:31.321301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 999/1966] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:31.323575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:31.325700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:31.332504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:31.333002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:31.333431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.334106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:31.334554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:31.335011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.365026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0d844176-5047-4aeb-a015-2d56f4105f96 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045347 Sep 05 14:47:31.365783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 968/1967] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:31.647462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:31.649608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:31.655589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:31.656072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:31.656509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.657196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:31.657651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:31.658078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:31.686893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66eeb74c-42ef-4337-9708-fec36a930acb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044037 Sep 05 14:47:31.687440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1000/1968] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:32.074753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:32.075387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:32.081371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.081850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.082284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.083010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.083461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.083882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.213518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:32.221199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9a4e0b5f-5242-4427-a47f-5f91f7c2e8e2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150357 Sep 05 14:47:32.221751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 969/1969] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:32.333542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:32.335646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:32.341774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.342255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.342731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.343450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.343925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.344330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.374389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07438a72-0f19-43da-ac33-c5ca724f00ea tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044941 Sep 05 14:47:32.374981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1001/1970] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:32.377993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:32.380718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:32.387130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.387609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.388053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.388727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.389176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.389599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.418874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55830580-2395-4e6d-ab78-1f2174ef0c85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045503 Sep 05 14:47:32.419423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 970/1971] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:32.699964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:32.702096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:32.708982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.709459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.709890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.710579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:32.711054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:32.711534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:32.741436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5767dea9-43a3-41af-8c7b-468c2867d4c8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045399 Sep 05 14:47:32.741983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1002/1972] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:33.243597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:33.244561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:33.250425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.250929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.251361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.252034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.252479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.252892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.381133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:33.387935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:33.389403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-df443e2f-51b7-471d-92c6-2b08a3655b42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149583 Sep 05 14:47:33.389960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 971/1973] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:33.390294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:33.398112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.398665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.399205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.399959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.400485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.401342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.431276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:33.432086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-38a98c59-1d64-4cc9-bd04-0962a1f178c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048395 Sep 05 14:47:33.432647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1003/1974] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:33.433464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:33.439431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.439911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.440346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.441040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.441492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.441915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.471978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-79b2b008-d3ca-4454-b7fd-16864a22f64b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Sep 05 14:47:33.472529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 972/1975] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:33.753387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:33.755571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:33.761435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.761905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.762333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.763037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:33.763484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:33.763897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:33.792815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6b3fa993-ad72-4660-ba42-7573b34a9d3b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043464 Sep 05 14:47:33.793352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1004/1976] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:34.413157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:34.413708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:34.420195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.421042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.421152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.421765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.422217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.422637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.444523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:34.447107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:34.453506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.453992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.454423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.455148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.456092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.456512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.487317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-75ba6743-79b3-4657-aad6-202e17750056 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046656 Sep 05 14:47:34.487883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1005/1977] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:34.492457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:34.494587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:34.500265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.500746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.501178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.501866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.502368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.502806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.532461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e4e05a0f-2ab0-4eb3-a311-9c1cb43e47de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043552 Sep 05 14:47:34.533025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1006/1978] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:34.552101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:34.559834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-543bf3c5-d5d2-4544-9fdc-74334f45c394 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151233 Sep 05 14:47:34.560391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 973/1979] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:34.806140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:34.808371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:34.814281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.814759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.815224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.815901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:34.816352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:34.816773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:34.845152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eaefaa12-8ff7-49fe-a92c-730297923132 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042971 Sep 05 14:47:34.845702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1007/1980] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:35.499748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:35.501885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:35.508799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.509274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.509709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.510391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.510870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.511294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.541234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b131e60e-92c9-4a67-8fb2-e481956fbef5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045497 Sep 05 14:47:35.541786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 974/1981] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:35.544573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:35.546700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:35.553017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.553490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.553913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.554592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.555069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.555487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.583109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:35.583724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:35.584886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-49d318f8-2fa2-44d1-971f-4bee7e5e4ecd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Sep 05 14:47:35.585476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1008/1982] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:35.589679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.590760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.591226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.591916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.592368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.592796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.596733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:35.723183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:35.731088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e9a160c4-e5b2-4c81-ae90-e024ba97eb5a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152352 Sep 05 14:47:35.731653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 975/1983] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:35.858281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:35.860418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:35.866301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.866835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.867276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.867960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:35.868414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:35.868839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:35.897442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-68f6315f-f1b9-443f-bbff-02cffa5212f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043211 Sep 05 14:47:35.897980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1009/1984] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:36.554105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:36.556272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:36.562595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.563102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.563534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.564212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.564687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.565660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.594077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-670d20c5-8d7a-408c-869c-67b12c32c4cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043936 Sep 05 14:47:36.594618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 976/1985] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:36.597406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:36.599615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:36.606336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.606759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.607249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.607937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.608399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.608832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.637541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-75d1ea71-e8ce-462c-a545-46d2870206a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044733 Sep 05 14:47:36.638092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1010/1986] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:36.753697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:36.754297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:36.760285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.760758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.761186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.761862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.762307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.762726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.891690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:36.899891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6098bd36-ba81-49d4-921f-6f41da0c9e20 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150126 Sep 05 14:47:36.900444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 977/1987] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:36.910284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:36.912720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:36.914636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:36.919364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.920009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.920535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.921217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:36.921667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:36.922086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:36.951404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-140f0ab1-0fcb-47df-9059-004003311c00 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045743 Sep 05 14:47:36.951975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1011/1988] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:37.607679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:37.609880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:37.616233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.616708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.617230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.617895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.618338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.618754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.647942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b73bcd7e-88a3-48d7-b0f2-538f1bb964b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044213 Sep 05 14:47:37.648491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 978/1989] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:37.650105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:37.652292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:37.659323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.659800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.660231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.660917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.661369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.661790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.691556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e6bcee0-40bd-4dac-9f6e-b9b2453cda10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045499 Sep 05 14:47:37.692111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1012/1990] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:37.923970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:37.924548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:37.930419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.930938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.931377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.932063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.932547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.932972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.964322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:37.966451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:37.972394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.972862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.973275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:37.973964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:37.974414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:37.974845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:38.003998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40bb7e44-03a6-46d1-9f9d-f5219f06625f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043557 Sep 05 14:47:38.004766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1013/1991] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:38.065311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:38.072982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-624a382a-114b-452c-a292-88c1bf5ce0b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152915 Sep 05 14:47:38.073549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 979/1992] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:38.661072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:38.663143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:38.669504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:38.669982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:38.670414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:38.671152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:38.671604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:38.672025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:38.701586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c04d1737-d054-4f96-a8ef-4e170a0bbbe3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045054 Sep 05 14:47:38.702968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1014/1993] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:38.705390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:38.707646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:38.714014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:38.714487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:38.714968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:38.715658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:38.716110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:38.716533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:38.746618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d039a9d5-5af1-4cc9-b55a-eba0d1ab53f7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045898 Sep 05 14:47:38.747185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 980/1994] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:39.016374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:39.018590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:39.024463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.024942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.025377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.026060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.026510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.026966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.030575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:39.056699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-510f7fae-92a3-4ca4-ae19-d2e35757a001 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044299 Sep 05 14:47:39.057244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1015/1995] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:39.096277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:39.096606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:39.102447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.103212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.103643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.104316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.104761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.105178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.232921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:39.241098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6dc4299f-c3ba-4983-b364-ded0c7bcdff0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149090 Sep 05 14:47:39.241660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 981/1996] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:39.713961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:39.716135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:39.723500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.723972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.724401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.725080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.725534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.725952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.755545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d51e42d4-670f-43d6-b0fd-2035bf82be05 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045563 Sep 05 14:47:39.756253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1016/1997] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:39.759040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:39.762022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:39.768861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.769335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.769763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.770481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:39.770971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:39.771397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:39.801775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3ef489cd-d4e7-4c11-a6aa-ca7c1d86d832 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046763 Sep 05 14:47:39.802320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 982/1998] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:40.069565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:40.071710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:40.077655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.078129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.078557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.079342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.079791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.080208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.109538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0491be66-fffc-4e7f-a5b1-2c6a27875601 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043912 Sep 05 14:47:40.110090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1017/1999] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:40.263852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:40.264455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:40.271116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.271585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.272010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.272683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.273127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.273546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.399653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:40.407267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cb189a8b-4383-4539-9834-d20f1951756c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147402 Sep 05 14:47:40.407828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 983/2000] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:40.767733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:40.769885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:40.776206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.776676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.777102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.777783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.778230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.778645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.807783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8d5f0911-9543-43b5-abca-18717553ab6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044050 Sep 05 14:47:40.808324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1018/2001] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:40.813714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:40.815987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:40.822241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.822712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.823172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.823871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:40.824324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:40.824738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:40.853554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-efff5750-715b-4f59-b2dd-03f545f5b198 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043514 Sep 05 14:47:40.854085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 984/2002] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:41.121701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:41.123905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:41.129746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.130224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.130655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.131364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.131820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.132239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.161740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e840f51e-8ef0-47a0-95a2-d9d27662bb8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044051 Sep 05 14:47:41.162281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1019/2003] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:41.430512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:41.431056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:41.437068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.437540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.437962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.438635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.439115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.439543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.572181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:41.579839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a7d8e3de-38f8-473c-af60-0023810aae60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153241 Sep 05 14:47:41.580391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 985/2004] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:41.820265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:41.822414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:41.828873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.829364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.829772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.831004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.831447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.831862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.862570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6275ff06-4526-4840-b22c-a6486bf8b8d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046315 Sep 05 14:47:41.863141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1020/2005] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:41.865822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:41.868022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:41.874358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.874859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.875292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.875967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:41.876413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:41.876846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:41.905750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3b913426-ae6f-4bc2-8632-2943bedc81b3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Sep 05 14:47:41.906292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 986/2006] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:42.174299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:42.176516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:42.182503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.183024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.183459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.184140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.184592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.185012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.213968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-63003c26-4d19-4f7f-9271-83ef9e7b30dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043717 Sep 05 14:47:42.214513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1021/2007] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:42.601931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:42.602564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:42.604787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:42.609387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.609864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.610298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.611074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.612026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.615333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.741160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:42.749006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d5936b66-e0d2-4eb2-a3ff-ec3e3abd73b9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151109 Sep 05 14:47:42.749560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 987/2008] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:42.875143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:42.877879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:42.884198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.884675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.885106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.885786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.886237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.886661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.915584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-498ada7c-1bca-44db-af53-e1eb13568a34 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044486 Sep 05 14:47:42.916126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1022/2009] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:42.918638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:42.920871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:42.927706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.928182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.928608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.929284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:42.929729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:42.930143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:42.958501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5d8a9759-2c78-4757-aa66-1e7a2b16b885 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Sep 05 14:47:42.959064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 988/2010] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:43.227028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:43.229423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:43.235222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.235690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.236114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.237446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.237891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.238306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.265860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-efece9c1-f26c-4523-93a2-a2af9964d491 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042958 Sep 05 14:47:43.266393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1023/2011] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:43.772775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:43.773377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:43.779307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.779783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.780211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.781012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.781465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.781877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.912268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:43.919836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a95c6fc2-ca30-4a68-9110-1ca42d8a6b81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151100 Sep 05 14:47:43.920408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 989/2012] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:43.927987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:43.930161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:43.936556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.937028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.937457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.938133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.938579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.939026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.968869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d0bb858d-5a73-4d42-a4b6-910b8713fa29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044805 Sep 05 14:47:43.969417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1024/2013] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:43.971028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:43.973194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:43.979380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.979859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.980313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:43.980986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:43.981434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:43.981855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:44.011072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-47b3664d-d57e-4c09-b631-dde8582d0ab8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044159 Sep 05 14:47:44.011616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 990/2014] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:44.278633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:44.280828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:44.286741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:44.287255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:44.287690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:44.288370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:44.288822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:44.289243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:44.318363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ec079223-69e9-4317-a7a3-ac142524b499 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043660 Sep 05 14:47:44.318936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1025/2015] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:44.943192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:44.943791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:44.950089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:44.950559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:44.951023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:44.951776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:44.952169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:44.952583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:44.982064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:44.984366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:44.991433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:44.991916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:44.992348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:44.993040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:44.993490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:44.993915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:45.023831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9071fcb5-65d8-4536-851b-9186a8667a6d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045930 Sep 05 14:47:45.024387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1026/2016] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:45.029041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:45.031185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:45.036923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:45.037399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:45.037832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:45.038512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:45.038997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:45.039421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:45.069069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-63cc7020-6522-47f2-b1bc-193bdc87d160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043667 Sep 05 14:47:45.069622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1027/2017] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:45.082191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:45.085589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:45.090136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f427866d-4bf3-4b87-be3d-69871f151784 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151418 Sep 05 14:47:45.090704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 991/2018] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:45.330551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:45.332799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:45.338657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:45.339174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:45.339607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:45.340288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:45.340739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:45.341156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:45.370529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4b692cb-9dc4-417c-b808-baf94873c19e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043938 Sep 05 14:47:45.371116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1028/2019] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:46.036807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:46.039016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:46.045881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.046352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.046782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.047495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.047947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.048385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.077300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-affcc69a-a235-4c20-9240-f0b012810786 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044876 Sep 05 14:47:46.077857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 992/2020] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:46.082144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:46.084347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:46.090512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.091030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.091468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.092154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.092619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.093042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.113664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:46.114272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:46.120148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.120636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.121068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.121748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.122198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.122620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.123676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-34e6c600-2da7-41fe-ab8d-69571b52e6bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046104 Sep 05 14:47:46.124228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1029/2021] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:46.252714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:46.260400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-efd3cd9e-7e29-4cc6-b97d-9c2b77bd5a04 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151196 Sep 05 14:47:46.260969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 993/2022] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:46.382282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:46.384421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:46.390312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.390808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.391247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.391925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:46.392379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:46.392800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:46.421542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0aecba20-33ec-487f-ac54-283e046588fd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043296 Sep 05 14:47:46.422093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1030/2023] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:47.089814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:47.091927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:47.098994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.099469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.099897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.100575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.101026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.101435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.131067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f1feb7dd-3407-48e1-90c6-a4620203e8cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045356 Sep 05 14:47:47.131611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 994/2024] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:47.135878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:47.138026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:47.144534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.145013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.145449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.146134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.146588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.147037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.171977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:47.177120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66715c96-add5-4a15-aafc-1b97aa8dc659 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045306 Sep 05 14:47:47.177667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1031/2025] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:47.284176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:47.284773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:47.290617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.291115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.291541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.292211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.292651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.293068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.419954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:47.428281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9b313fa2-53f0-4990-8937-592d6bf0c173 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148523 Sep 05 14:47:47.428841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 995/2026] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:47.434127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:47.436288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:47.442576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.443093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.443530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.444214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:47.444683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:47.445088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:47.474174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-979758bf-298d-4936-abc3-f1ad40b64470 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043984 Sep 05 14:47:47.474731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1032/2027] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:48.144182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:48.146302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:48.152718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.153189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.153616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.154292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.154734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.155190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.184013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d4ff5851-9bc2-4b54-a890-533a319f5f22 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044473 Sep 05 14:47:48.184549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 996/2028] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:48.196984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:48.199226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:48.205622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.206092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.206517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.207226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.207670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.208087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.236883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f4cc89e-1ed2-44d4-8e6b-f6630569cac5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Sep 05 14:47:48.237416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1033/2029] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:48.451115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:48.451629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:48.457468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.457945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.458377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.459088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.459541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.459959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.485883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:48.488561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:48.494752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.495282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.495841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.496542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:48.496993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:48.497415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:48.526558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eb89dfeb-3539-4422-a778-16e29d93b203 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Sep 05 14:47:48.527155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1034/2030] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:48.587821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:48.595527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-54a30783-5e58-44a7-a7a8-472164f8a810 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148451 Sep 05 14:47:48.596583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 997/2031] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:49.196086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:49.198268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:49.204842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.205904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.206341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.207059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.207510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.207933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.237026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a75f4bdd-1677-4557-a11b-d51d31ebef75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044968 Sep 05 14:47:49.237574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1035/2032] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:49.249020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:49.251150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:49.257457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.258036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.258466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.259177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.259624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.260041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.289324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e7a5c38d-f3c6-4ad2-bb00-0746364109f5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Sep 05 14:47:49.289857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 998/2033] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:49.538883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:49.541107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:49.547067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.547550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.547987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.548671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.549134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.549555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.578007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-83107c07-2ca4-4f74-a739-8f7463cd1c79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043087 Sep 05 14:47:49.578545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1036/2034] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:49.618703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:49.619381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:49.625266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.625742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.626175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.626896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:49.627872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:49.628291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:49.761448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:49.769139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-72ac1348-14c2-403e-8e47-360ab607e847 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154335 Sep 05 14:47:49.769701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 999/2035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:50.249439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:50.251707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:50.258145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.258638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.259106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.259819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.260300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.260725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.289511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96bc3f5f-c8a8-437a-8c24-09d294212ab4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044074 Sep 05 14:47:50.290053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1037/2036] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:50.302060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:50.304237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:50.310735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.311248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.311684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.312372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.312823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.313246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.341536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8d1d1c20-8e07-4716-84aa-f518c9322b4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044067 Sep 05 14:47:50.342076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1000/2037] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:50.591136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:50.593290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:50.599809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.600286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.600716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.601398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.601849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.602269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.630506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6cd4968a-9d68-4695-8554-3abb253fa7db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043392 Sep 05 14:47:50.631080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1038/2038] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:50.791934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:50.792557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:50.798418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.799532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.799964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.800638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:50.801083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:50.801498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:50.927938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:50.935461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1d86435f-2652-4642-a683-967ecfdd2c15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147371 Sep 05 14:47:50.936024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1001/2039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:51.302152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:51.304336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:51.310705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.311216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.311647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.312331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.312783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.313207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.342066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-de42b6a8-32b9-449a-977b-99e95511deb1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043959 Sep 05 14:47:51.342608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1039/2040] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:51.353705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:51.355855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:51.362083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.362558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.363021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.363698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.364147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.364564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.393050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3b9ad16a-9995-467e-a89e-c47adf966a61 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043083 Sep 05 14:47:51.393583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1002/2041] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:51.643715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:51.645771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:51.651661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.652141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.652572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.653266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.653713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.654133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.682843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e78e0319-b572-442b-ad5e-58b2fb4607c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043822 Sep 05 14:47:51.683412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1040/2042] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:51.957613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:51.958144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:51.964182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.964651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.965076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:51.965749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:51.966193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:51.966615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.097128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:52.105020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-44d2069e-6be4-4fe0-9772-2eb66f7cf6a9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151473 Sep 05 14:47:52.105574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1003/2043] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:52.355009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:52.357164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:52.363740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:52.364219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:52.364654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.365331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:52.365783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:52.366234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.395950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b7f7cbfe-71b0-4107-a491-85dfdcc45bc8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045224 Sep 05 14:47:52.396507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1041/2044] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:52.405294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:52.407445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:52.413760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:52.414227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:52.414654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.415364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:52.415811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:52.416227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.444827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-379b531b-a681-462f-8da1-00743a56f664 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043496 Sep 05 14:47:52.445361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1004/2045] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:52.694331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:52.696498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:52.702318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:52.702813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:52.703245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.703918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:52.704362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:52.704779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:52.733899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a13026b6-3d59-41e5-bced-7a03e57d2879 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043578 Sep 05 14:47:52.734440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1042/2046] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:53.128593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:53.129197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:53.135112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.135560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.135986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.136661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.137105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.137519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.270244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:53.274739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3709bbb4-3fe7-4a31-9586-e7ecbef05d0b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150494 Sep 05 14:47:53.275321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1005/2047] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:53.408424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:53.410538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:53.416972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.417446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.417877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.418557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.419053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.419477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.449753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-71d76309-1a83-4e0a-a67a-1fc503240a90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045319 Sep 05 14:47:53.450318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1043/2048] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:53.456174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:53.464457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:53.464785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.465265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.465707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.466392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.466867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.467292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.497065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-45d7e1b6-f471-4b26-ab3a-afae954845dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044772 Sep 05 14:47:53.497666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1006/2049] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:53.746240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:53.748633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:53.755077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.755559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.755986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.756657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:53.757101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:53.757513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:53.785631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-67824e56-f057-49d1-9e74-0166965f9cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043437 Sep 05 14:47:53.786157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1044/2050] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:54.297413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:54.297951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:54.304492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.304973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.305403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.306076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.306524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.306971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.434292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:54.442440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a1e4a5fd-1b69-44f8-ac28-a75464312e79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148854 Sep 05 14:47:54.443027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1007/2051] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:54.461471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:54.463671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:54.469953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.470423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.470905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.471583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.472027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.472444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.503774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1d28ab9d-114e-46a1-92fd-6010d216be24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046180 Sep 05 14:47:54.504514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1045/2052] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:54.509244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:54.511382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:54.517747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.520779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.520779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.520779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.520779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.521196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.537128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:54.555117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bcbb9230-963a-4139-b638-fb4829965e3e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044907 Sep 05 14:47:54.555117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1008/2053] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:54.797636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:54.800468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:54.806394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.806851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.807291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.807969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:54.808422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:54.808843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:54.837899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2651d88-8528-4c6d-aa97-bce640ef7d16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044288 Sep 05 14:47:54.838437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1046/2054] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:55.465233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:55.465759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:55.472054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.472525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.472982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.473658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.474101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.474544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.516360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:55.519216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:55.525774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.526255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.526692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.527412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.527864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.528289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.557253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-17bcd054-1460-47e2-bdd5-f6b91d77f64f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044919 Sep 05 14:47:55.557828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1047/2055] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:47:55.562265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:55.564914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:55.570743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.571253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.571686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.572371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.572825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.573247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.590009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:47:55.603010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3c7ccbc-abb4-411d-8a5e-a2456803ebe9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044175 Sep 05 14:47:55.607187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1048/2056] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:55.609285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:55.617187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-416b6b9e-b41c-4067-a5c1-44ed68bc532f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155949 Sep 05 14:47:55.617744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1009/2057] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:55.850043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:55.852203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:55.858817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.859307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.859744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.860424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:55.860877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:55.861815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:55.890198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0b79b44-d5a7-4939-ad1f-0cc5761a2cb6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044098 Sep 05 14:47:55.890735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1049/2058] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:56.569739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:56.571935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:56.578323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.578811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.579253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.580438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.580885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.581300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.610239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-44a74406-759b-4907-b9f1-99b850e57875 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044510 Sep 05 14:47:56.610857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1010/2059] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:56.617507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:56.619720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:56.626095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.626576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.627031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.627703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.628149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.628563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.641004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:56.641647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:56.648093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.648573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.649004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.649687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.650139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.650554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.657668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a119ccbf-fe3b-4c44-a870-93bd957d5ecf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044050 Sep 05 14:47:56.658909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1050/2060] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:56.779696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:56.790184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-344cfc02-c23f-4c7c-a870-50ef240630a0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150771 Sep 05 14:47:56.790184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1011/2061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:47:56.902463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:56.904637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:56.911053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.911534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.911966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.912642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:56.913097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:56.913513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:56.942097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1134298b-990b-480e-a3d2-841f01c26dfc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043671 Sep 05 14:47:56.942634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1051/2062] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:57.622362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:57.624532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:57.630903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.631381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.631810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.632486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.632928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.633341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.662872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-39f5e097-2374-487e-a16f-4a1c9b7334b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044521 Sep 05 14:47:57.663415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1012/2063] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:57.670641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:57.672816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:57.679799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.680278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.680710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.681394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.681846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.682268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.710473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ebb06ce-586a-4229-8035-5a3f22cddede tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043821 Sep 05 14:47:57.711054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1052/2064] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:47:57.810764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:57.811406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:57.817303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.817779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.818214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.818964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.819419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.819841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.950357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:57.954098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:57.956888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:57.958846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8c639860-2b73-4906-a1e4-7af46d73e0ba tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151867 Sep 05 14:47:57.959425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1013/2065] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:57.963086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.963570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.964007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.964695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:57.965154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:57.965572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:57.995822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0cdb28ac-dcb9-43bc-9e64-99baad1354e3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045784 Sep 05 14:47:57.996369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1053/2066] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:58.676178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:58.678345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:58.684746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:58.685318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:58.685760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:58.686443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:58.686923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:58.687361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:58.716572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5093b52b-4053-4d5d-92b4-8745b2e896b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045007 Sep 05 14:47:58.717122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1014/2067] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:58.723223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:58.725423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:58.732056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:58.732527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:58.732972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:58.733621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:58.734073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:58.734490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:58.762515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e55681fe-dbe3-449a-ae8e-14797adc0494 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043779 Sep 05 14:47:58.763082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1054/2068] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:58.981646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:58.982252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:58.988198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:58.988677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:58.989111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:58.989790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:58.990240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:58.990659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.007248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:59.009372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:59.015161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:59.015635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:59.016066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.016747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:59.017193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:59.018171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.047986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1334aac-3aae-44b2-89fb-438d85850287 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044665 Sep 05 14:47:59.048788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1055/2069] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:47:59.119121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:47:59.126821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ee1adb19-bbab-4782-a29d-e37f635a8195 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149282 Sep 05 14:47:59.127391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1015/2070] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:47:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:47:59.729958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:59.732193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:59.738546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:59.739067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:59.739500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.740179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:59.740629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:59.741050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.769869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-78f6e151-6849-49cb-a3dc-d34229e62798 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044131 Sep 05 14:47:59.770560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1056/2071] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:47:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:47:59.774802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:47:59.777007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:47:59.784197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:59.784671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:59.785103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.785788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:47:59.786239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:47:59.786696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:47:59.815382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1d033bc1-80fd-4f7b-9d16-f051bbda1fdb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044643 Sep 05 14:47:59.815924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1016/2072] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:47:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:00.060508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:00.062605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:00.068530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.069009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.069443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.070121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.070575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.071051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.099748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-276711db-5499-4962-a49c-dae1770ea4b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043281 Sep 05 14:48:00.100292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1057/2073] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:00.148874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:00.150191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:00.155669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.156143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.156569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.157240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.157684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.158647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.292749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:00.300317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0111ecd1-a259-4a66-a312-b9df344960ee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155361 Sep 05 14:48:00.300874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1017/2074] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:00.782266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:00.784930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:00.791464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.791945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.792376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.793056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.793509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.793931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.822886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3cbdb55e-d424-4bc9-a439-af9f872164b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044572 Sep 05 14:48:00.823438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1058/2075] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:48:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:48:00.828418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:00.830579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:00.837257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.837743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.838151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.838860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:00.839310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:00.839725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:00.869143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c741f52-20cf-48f3-ad06-086837fd1d4e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044652 Sep 05 14:48:00.869682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1018/2076] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:01.112366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:01.114510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:01.120499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.121005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.121476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.122151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.122601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.123053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.151395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3e352b6-f5a6-46cd-86a8-342b195217a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042998 Sep 05 14:48:01.151937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1059/2077] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:01.322809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:01.323417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:01.329309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.329778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.330808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.331518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.331962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.332377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.461777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:01.469498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-17f2a986-17b2-4f2a-b1b3-ced293864eab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150530 Sep 05 14:48:01.470780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1019/2078] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:01.835397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:01.837527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:01.843987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.844463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.844896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.845580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.846028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.846448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.875320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b21a8156-83e6-4818-9797-250a04669020 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043921 Sep 05 14:48:01.875863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1060/2079] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:48:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:48:01.881942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:01.884132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:01.890184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.890656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.891115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.891818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:01.892263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:01.892678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:01.920740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-63d84bb6-602e-44a9-bd33-56ebc58d06b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042746 Sep 05 14:48:01.921279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1020/2080] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:02.164173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:02.166293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:02.168462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:02.173040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.173512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.174530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.175228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.175676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.176091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.204335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7c565995-dcdd-442b-9038-20eaf68ca58d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044150 Sep 05 14:48:02.204886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1061/2081] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:02.492862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:02.493467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:02.499474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.499943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.500369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.501044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.501488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.502530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.632097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:02.639844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1bfcb240-7c4b-45dc-801a-b7e5a885540e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150895 Sep 05 14:48:02.640402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1021/2082] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:02.888496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:02.890671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:02.898095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.898575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.899041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.899709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.900156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.900603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.928487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-16c787d4-61b2-41ef-b812-e5b82d3ef8b2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043987 Sep 05 14:48:02.929025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1062/2083] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:48:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:48:02.933573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:02.935759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:02.942726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.943228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.943656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.944336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:02.944779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:02.945196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:02.974193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0d060815-081e-4ae0-97d9-ce86c9c40475 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044613 Sep 05 14:48:02.974730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1022/2084] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:03.216718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:03.218885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:03.224808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.225272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.225704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.226381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.226849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.227276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.256749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-27cb2760-ce89-4600-9ca9-c0bf1ff50d53 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044015 Sep 05 14:48:03.257286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1063/2085] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:03.662866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:03.663478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:03.669363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.669840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.670304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.671016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.671468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.671887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.804003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:03.811667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5c5cfe9e-6866-4fb8-b0ea-2e8d08704a81 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152665 Sep 05 14:48:03.812223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1023/2086] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:03.940741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:03.942877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:03.949131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.949601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.950032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.950698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.951244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.951663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.981299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-630086fa-b5a9-4b25-8340-cfaf616c8ef1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044478 Sep 05 14:48:03.982005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1064/2087] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:48:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:48:03.986625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:03.988806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:03.995308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.995794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.996236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:03.996988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:03.997436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:03.997856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:04.028312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e84c4c08-b0c4-4558-be91-e2e1041745e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045579 Sep 05 14:48:04.028870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1024/2088] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:04.269471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:04.271723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:04.277642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:04.278115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:04.278544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:04.279251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:04.279696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:04.280115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:04.284290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:04.308891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c397d97-9ee5-44ea-b5fa-cc5a0dd426e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043841 Sep 05 14:48:04.309445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1065/2089] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:04.834370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:04.835041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:04.840974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:04.841448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:04.841879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:04.842557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:04.843035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:04.843460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:04.847986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:04.971823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:04.979796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b35f243a-15ac-4666-a93b-2f08fd517e99 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149771 Sep 05 14:48:04.980366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1025/2090] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:04.993536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:04.995707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:05.002500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:05.003008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:05.003444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:05.004114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:05.004561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:05.004979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:05.034300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-939b62ae-528f-4dec-9e75-caca582e0975 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044791 Sep 05 14:48:05.034857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1066/2091] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:48:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:48:05.041461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:05.043617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:05.049978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:05.050487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:05.050967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:05.051659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:05.052137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:05.052565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:05.082545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-168003e9-56e7-46e9-8732-e1e214145af8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045079 Sep 05 14:48:05.083130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1026/2092] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:05.322170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:05.324269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:05.330711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:05.331226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:05.331662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:05.332338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:05.332788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:05.333209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:05.361917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9a557f16-861a-417a-ab0a-968e19588a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044456 Sep 05 14:48:05.362461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1067/2093] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:06.003551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:06.004154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:06.009998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.010470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.010928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.011605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.012051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.012473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.046809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:06.049703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:06.056230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.056787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.057290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.058071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.058527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.058986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.088995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b568b603-6dcb-48b4-8484-a76bcd9eef70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045793 Sep 05 14:48:06.089497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1068/2094] 10.222.0.15 () {60 vars in 1343 bytes} [Mon Sep 5 14:48:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:48:06.099563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:06.101709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:06.107914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.108401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.108842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.109533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.109986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.110412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.140152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c01a3d59-666d-4848-8079-b91b02815746 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044969 Sep 05 14:48:06.140711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1069/2095] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:06.147705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:06.155352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-023dda1e-885a-4cb8-a405-05d61e2ab161 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155678 Sep 05 14:48:06.155896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1027/2096] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:05 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:06.373659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:06.375900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:06.381838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.382320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.382756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.383571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:06.384027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:06.384939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:06.414646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f2778e7-06fb-49db-a225-ccf05ebd3900 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045023 Sep 05 14:48:06.415454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1070/2097] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:07.101665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:48:07.104123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:07.110770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.111774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.112200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.112872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.113315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.113730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.139210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [0166ae40-1f4d-4423-ab52-514ea0ed3b36] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 14:48:07.152401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:07.154521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:07.160963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.161444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.161874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.162543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.163017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.163434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.193172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6bd6192e-90e6-4c8a-b051-760ea1f680ad tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044789 Sep 05 14:48:07.193722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1071/2098] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:07.197904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:07.198494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:07.203803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.204275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.204701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.205398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.205843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.206259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.333006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:07.340589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf826686-4e18-43ac-91af-1c4172895d52 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.145966 Sep 05 14:48:07.341143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1072/2099] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:07.427660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:07.429756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:07.435530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.436005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.436429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.437100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:07.437543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:07.437956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:07.465540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c02ade90-470b-4446-b84e-806bf952432d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042454 Sep 05 14:48:07.466069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1073/2100] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:08.146240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [0166ae40-1f4d-4423-ab52-514ea0ed3b36] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50502. Sep 05 14:48:08.204594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:48:08.207445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:08.213842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:08.214312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:08.214738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:08.215429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:08.215873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:08.216287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:08.222845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f82124dc-f4a4-482c-b1c0-05fac820f21c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/action" status: 200 len: 37471 microversion: 2.20 time: 1.125081 Sep 05 14:48:08.223715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1028/2101] 10.222.0.15 () {62 vars in 1319 bytes} [Mon Sep 5 14:48:07 2022] POST /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166/action => generated 37471 bytes in 1126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:48:08.312026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7ec4863-1d1f-4c96-af7d-d2d7b7a9113d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/action" status: 200 len: 76152 microversion: 2.1 time: 0.111025 Sep 05 14:48:08.312643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1074/2102] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:48:08 2022] POST /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4/action => generated 76152 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 05 14:48:08.366029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:08.366666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:08.373921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:08.374394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:08.374840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:08.375518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:08.375960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:08.376375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:08.478931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:08.481210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:08.488112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:08.488590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:08.489019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:08.489702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:08.490151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:08.490575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:08.506585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:08.514939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-36cac839-1789-4b7e-b38d-2dc171ff6db6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154359 Sep 05 14:48:08.515498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1029/2103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:08.521124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b34c1e5-d67e-4ff5-9323-44b8345325cf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046943 Sep 05 14:48:08.521666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1075/2104] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:09.532753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:09.535649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:09.539002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:09.539622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:09.542072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:09.542550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:09.543017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:09.543705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:09.544179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:09.544593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:09.545829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:09.546313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:09.546754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:09.547456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:09.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:09.548331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:09.573721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-29477541-52e6-4900-a608-7af91c78a1f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044924 Sep 05 14:48:09.574264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1030/2105] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:09.680698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:09.688354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7141339a-9493-49e9-885e-29de268802fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153190 Sep 05 14:48:09.688911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1076/2106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:10.586685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:10.588846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:10.595233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:10.595705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:10.596138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:10.596849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:10.597296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:10.597716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:10.625626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0c50a647-a6f8-41be-9576-fb5ddcc85314 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042881 Sep 05 14:48:10.626164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1031/2107] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:10.711581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:10.712196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:10.718715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:10.719239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:10.719677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:10.720364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:10.720847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:10.721275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:10.850080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:10.858017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ddda02a-354a-40c9-a54c-fe833c9f7d4d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150352 Sep 05 14:48:10.858579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1077/2108] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:11.637629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:11.639812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:11.646618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:11.647119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:11.647548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:11.648217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:11.648659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:11.649072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:11.677863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b75ad45f-ea44-4aff-a212-168b23b7681b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044198 Sep 05 14:48:11.678389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1032/2109] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:11.881941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:11.882577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:11.889161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:11.889589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:11.890047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:11.890753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:11.891254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:11.891685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:12.023501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:12.031099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-21074364-f71b-4a04-94a8-4c3e9a664e3f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153018 Sep 05 14:48:12.031658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1078/2110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:12.689745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:12.691917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:12.694478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=92 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:12.699101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:12.699573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:12.700003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:12.700682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:12.701126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:12.701543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:12.731472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e6ba3c99-ef3b-4a68-8276-d4bf8957632f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045733 Sep 05 14:48:12.732029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1033/2111] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:13.057176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:13.057808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:13.065440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:13.065908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:13.066344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:13.067040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:13.067488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:13.067905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:13.198064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:13.206251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e89ab8c-064f-45c5-9e35-f5a3d8cb17b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156315 Sep 05 14:48:13.206869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1079/2112] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:13.743965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:13.746229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:13.752643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:13.753117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:13.753546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:13.754256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:13.754713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:13.755154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:13.783968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-582e526c-e07c-4fb8-b538-aae83bdb0487 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043468 Sep 05 14:48:13.784511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1034/2113] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:14.229554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:14.230160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:14.232433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:48:14.232575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:48:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:48:14.239673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:14.240145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:14.240569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:14.241246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:14.241688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:14.242103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:14.373090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:14.380833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-405ee7db-2540-4993-9610-b6fdf00411b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155365 Sep 05 14:48:14.381425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1080/2114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:14.797549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:14.800361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:14.806737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:14.807244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:14.807675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:14.808386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:14.808832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:14.809253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:14.838136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e0d2a5dc-3091-4928-8f06-a461b9fb96a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045656 Sep 05 14:48:14.838670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1035/2115] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:15.404269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:15.404837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:15.411268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:15.411748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:15.412181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:15.412864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:15.413313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:15.413749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:15.542319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:15.550614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-76febbdc-eaaa-401e-8d37-62115806e9d7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150298 Sep 05 14:48:15.551241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1081/2116] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:15.850898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:15.853067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:15.859777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:15.860253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:15.860687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:15.861981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:15.862427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:15.862877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:15.890634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a719e9ff-fac2-459f-87f3-19695ada7b64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043713 Sep 05 14:48:15.891220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1036/2117] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:16.573930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:16.574542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:16.581561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:16.582035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:16.582461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:16.583160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:16.583608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:16.584308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:16.588182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:16.711728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:16.719354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2afec9a-add2-43a0-a1a8-053d770cead6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149544 Sep 05 14:48:16.719914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1082/2118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:16.902969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:16.905115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:16.911488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:16.911955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:16.912386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:16.913068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:16.913516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:16.913934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:16.942886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dcc9d61f-20f9-44e5-8daa-b8c83472f36c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043859 Sep 05 14:48:16.943374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1037/2119] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:17.741477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:17.742081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:17.748517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:17.748988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:17.749412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:17.750084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:17.750528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:17.750975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:17.881172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:17.888695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c7afc05-ccc8-40a5-959e-1036ffab6b11 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151081 Sep 05 14:48:17.889251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1083/2120] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:17.955728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:17.957898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:17.964215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:17.964685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:17.965116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:17.965792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:17.966242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:17.966667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:17.994964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-800b7c59-2d74-4344-847b-af1129dbbda9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Sep 05 14:48:17.995439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1038/2121] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:18.912136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:18.912738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:18.919127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:18.919602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:18.920030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:18.920705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:18.921159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:18.921576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:19.007843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:19.010134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:19.016685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:19.017319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:19.017820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:19.018584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:19.019063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:19.019494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:19.050020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f7a30025-6db0-4c2e-a002-abb55c57b768 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045890 Sep 05 14:48:19.050406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1039/2122] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:19.052179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:19.059928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-14a922df-5b94-4977-8a34-0623ad9b2b90 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151666 Sep 05 14:48:19.060466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1084/2123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:20.083316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:20.084173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:20.090540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:20.091059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:20.091535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:20.092258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:20.092718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:20.093145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:20.129134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:20.131374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:20.137457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:20.137966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:20.138425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:20.139182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:20.139638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:20.140068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:20.171135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4f6d119e-573c-4d9b-b90b-2e921a377b4c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.112791 Sep 05 14:48:20.171135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1040/2124] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:20.226499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:20.234423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-58eb9fb1-0d01-42e2-af37-22ecb6d70071 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.155039 Sep 05 14:48:20.235019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1085/2125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:21.182300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:21.184505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:21.191512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:21.191982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:21.192411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:21.193087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:21.193534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:21.193966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:21.222150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-244f1164-031e-4bc6-9920-452d7bf8ed30 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043747 Sep 05 14:48:21.222729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1041/2126] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:21.257798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:21.258411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:21.264736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:21.265215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:21.265648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:21.266324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:21.266776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:21.267221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:21.393433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:21.401048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3d906641-c546-4b32-b32f-9c67dedf4e53 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147051 Sep 05 14:48:21.401604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1086/2127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:22.234837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:22.237532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:22.243872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:22.244347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:22.244774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:22.245454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:22.245903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:22.246322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:22.249934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:22.274815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-67d6c9e1-c10a-4462-8dfc-e92b523c2fef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043976 Sep 05 14:48:22.275366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1042/2128] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:22.423824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:22.424961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:22.431624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:22.432098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:22.432530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:22.433202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:22.433656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:22.434069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:22.560801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:22.568665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-112d1c86-b439-429c-9cc2-9014eacc7189 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148777 Sep 05 14:48:22.570344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1087/2129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:23.287414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:23.289537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:23.296377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:23.296868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:23.297280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:23.297985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:23.298438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:23.298891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:23.326913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0926ca63-68d5-42c6-ab9a-aedfe5a42abd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043425 Sep 05 14:48:23.327460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1043/2130] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:23.591641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:23.592253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:23.598778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:23.599290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:23.599755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:23.600443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:23.600899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:23.601326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:23.732229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:23.740420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bef48d4e-dd89-494b-932a-a84f6cf0e4b4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152659 Sep 05 14:48:23.740983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1088/2131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:24.339732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:24.341915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:24.349266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:24.349674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:24.350100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:24.350835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:24.351282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:24.351695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:24.380106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56daa742-37f1-45b0-9af0-c56ccfef8f14 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044267 Sep 05 14:48:24.380654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1044/2132] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:24.764494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:24.765094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:24.772064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:24.772545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:24.772984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:24.773673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:24.774125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:24.774550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:24.975374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:24.983326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a52d678-d65f-488c-b354-e3a99c2a76fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.222839 Sep 05 14:48:24.983890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1089/2133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:24 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:25.392413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:25.395170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:25.401488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:25.401963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:25.402389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:25.403091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:25.403536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:25.403949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:25.431547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-356d00e6-0388-4773-bb00-b4664d292dac tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043119 Sep 05 14:48:25.432072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1045/2134] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:26.006852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:26.007473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:26.013879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:26.014359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:26.014803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:26.015495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:26.015949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:26.016369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:26.143349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:26.150953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-05b2a819-d527-4b47-a1fc-0a672540a91c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148508 Sep 05 14:48:26.151512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1090/2135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:26.444210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:26.446266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:26.452744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:26.453219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:26.453646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:26.454360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:26.454825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:26.455248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:26.484457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-81ef7a1f-0b5a-420d-8321-b788ee7900c3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044377 Sep 05 14:48:26.484996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1046/2136] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:27.174762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:27.175397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:27.181772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:27.182258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:27.182727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:27.183441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:27.183895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:27.184323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:27.311711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:27.319897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a8dff6fc-0acb-4b8b-8fa5-e844f4e4075e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149513 Sep 05 14:48:27.320459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1091/2137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:27.496695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:27.498839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:27.505099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:27.505570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:27.505998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:27.506671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:27.507140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:27.507557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:27.536269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ef87865e-2b4b-41d1-98cb-6fb19380ceda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043583 Sep 05 14:48:27.536806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1047/2138] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:28.342859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:28.343472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:28.351937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:28.351937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:28.351937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:28.352341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:28.352801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:28.353279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:28.483244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:28.491941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-32c65267-389e-4b2d-b5fa-53aee44dc1a2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152945 Sep 05 14:48:28.492502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1092/2139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:28.548111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:28.550935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:28.558193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:28.558767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:28.559426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:28.560175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:28.560628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:28.561044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:28.589467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3d86a845-98af-4c4a-be8a-c8e0b1574fe5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045395 Sep 05 14:48:28.590249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1048/2140] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:29.514608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:29.515246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:29.521719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:29.522194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:29.522625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:29.523330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:29.523784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:29.524199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:29.601632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:29.604013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:29.610374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:29.610871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:29.611492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:29.612677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:29.613123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:29.613539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:29.642364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b267afa8-d2f2-421e-b014-16ca66c1195d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Sep 05 14:48:29.642960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1049/2141] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:29.653417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:29.661135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-95e313dc-f68b-4835-bffd-6a312af63888 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.150418 Sep 05 14:48:29.661690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1093/2142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:30.654942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:30.657061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:30.664052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:30.664527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:30.664959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:30.665637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:30.666084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:30.666538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:30.684160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:30.684755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:30.691084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:30.691561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:30.691987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:30.692660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:30.693107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:30.693523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:30.695622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eef30905-c65f-4e4a-b0b5-abba484bc74c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044673 Sep 05 14:48:30.696177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1050/2143] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:30.823917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:30.831841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-41c8e6a1-8a85-4d84-921e-16c102108cf0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151502 Sep 05 14:48:30.832654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1094/2144] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:31.708159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:31.710200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:31.716652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:31.717121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:31.717553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:31.718238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:31.718688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:31.719134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:31.749082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-67de116a-e522-4331-84f3-fd222b135713 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044964 Sep 05 14:48:31.749643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1051/2145] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:31.855536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:31.856175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:31.863016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:31.863494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:31.863921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:31.864596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:31.865043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:31.865462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:31.991840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:31.999447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce94a0f5-8867-45de-96a5-79e3c53257da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148134 Sep 05 14:48:32.000011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1095/2146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:32.761327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:32.763497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:32.770345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:32.770839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:32.771276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:32.771950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:32.772397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:32.772813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:32.800331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a946693d-a998-4405-a0b4-8ba04c9f3ee4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042952 Sep 05 14:48:32.800802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1052/2147] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:33.023497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:33.024122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:33.026440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=70 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:33.031203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:33.031693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:33.032152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:33.032836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:33.033292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:33.033718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:33.163077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:33.170692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-52f915ac-c155-49b1-be96-7c7fe4df194b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151102 Sep 05 14:48:33.171281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1096/2148] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:33.812675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:33.814852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:33.821342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:33.821813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:33.822240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:33.822949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:33.823394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:33.823812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:33.852622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-37d82267-b84b-444c-b726-c900a89efe72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043940 Sep 05 14:48:33.853164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1053/2149] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:34.195291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:34.195925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:34.202419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:34.202929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:34.203365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:34.204046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:34.204501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:34.204922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:34.338428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:34.346146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f1d3711e-1d3d-4fd2-a58c-14c25f367d06 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.154644 Sep 05 14:48:34.347298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1097/2150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:34.865977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:34.868181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:34.874719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:34.875269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:34.875788 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:34.876463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:34.876906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:34.877323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:34.906148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-537dd94c-29d8-42b4-bccf-b33518270b10 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044863 Sep 05 14:48:34.906694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1054/2151] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:35.370271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:35.370906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:35.377342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:35.377825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:35.378928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:35.379613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:35.380066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:35.380490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:35.518950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:35.522331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:35.527114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2d03565-82eb-4c7c-9900-173e4ae95086 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.160685 Sep 05 14:48:35.527685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1098/2152] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:35.919187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:35.921369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:35.928285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:35.928758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:35.929185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:35.929861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:35.930303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:35.930718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:35.958116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8962a42c-1cef-4bed-961c-f30a5881135d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042943 Sep 05 14:48:35.958652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1055/2153] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:36.549385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:36.549983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:36.556751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:36.557221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:36.557644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:36.558314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:36.558759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:36.559210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:36.689505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:36.697653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f97a2176-d748-4cb6-9965-ae6f4f5b683c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152119 Sep 05 14:48:36.698211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1099/2154] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:36.971056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:36.973218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:36.979845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:36.980322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:36.980755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:36.981428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:36.981878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:36.982298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:37.011804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83195b90-ed4e-47f6-a6e2-acebf0f7dbbc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044993 Sep 05 14:48:37.012354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1056/2155] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:37.722550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:37.723189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:37.729858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:37.730337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:37.730766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:37.731471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:37.731919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:37.732340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:37.860142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:37.868491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1757ab28-4932-45d2-9ef6-3a197abe3698 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149862 Sep 05 14:48:37.869074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1100/2156] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:38.024615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:38.026683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:38.033352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:38.033827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:38.034260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:38.035474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:38.035928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:38.036395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:38.064715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b580dfc4-72e9-4d30-951b-0ddbfe6110c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044122 Sep 05 14:48:38.065256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1057/2157] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:38.891704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:38.892439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:38.899423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:38.899898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:38.900325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:38.900992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:38.901436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:38.901849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:39.032872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:39.040418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-17a5c01f-0c17-4084-b929-6d3fdaff707d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152547 Sep 05 14:48:39.040973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1101/2158] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:38 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:39.076128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:39.078214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:39.085339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:39.085820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:39.086256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:39.087019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:39.087479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:39.087909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:39.112347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:39.117595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e575b6c9-31a4-4d48-a353-cfbbb68a989a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045577 Sep 05 14:48:39.123394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1058/2159] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:40.063062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:40.063663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:40.070075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:40.070551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:40.071005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:40.071678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:40.072125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:40.072580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:40.134450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:40.136763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:40.143266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:40.143780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:40.144214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:40.145386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:40.145831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:40.146253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:40.180346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6799566b-879a-4496-97b8-d6af863e4cfb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050199 Sep 05 14:48:40.181096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1059/2160] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:48:40.202111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:40.210182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4e0d2f4c-74a5-4cdf-9632-f4a0f6d461dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151039 Sep 05 14:48:40.210739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1102/2161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:41.191976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:41.194106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:41.200647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:41.201128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:41.201560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:41.202236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:41.202690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:41.203136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:41.232006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-71b1f1eb-8200-4099-83d6-c05fcad72c52 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043958 Sep 05 14:48:41.232559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1060/2162] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:41.233549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:41.234157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:41.241393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:41.241865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:41.242294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:41.243001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:41.243448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:41.243865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:41.370033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:41.377607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-515231e1-4396-45cc-bec1-b3c9deb5c48c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147797 Sep 05 14:48:41.378160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1103/2163] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:42.243934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:42.246070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:42.252670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:42.253153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:42.253587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:42.254909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:42.255362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:42.255783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:42.283766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d074a9d6-2c94-41de-8061-aa7c00aa75aa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043750 Sep 05 14:48:42.284304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1061/2164] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:42.400202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:42.400723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:42.407188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:42.407662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:42.408091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:42.408757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:42.409202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:42.409616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:42.540770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:42.548519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f024a92c-5f84-4895-8e8f-752d88f1348b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.152209 Sep 05 14:48:42.549085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1104/2165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:43.299992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:43.303386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:43.305693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=58 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:43.310643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:43.311232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:43.311670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:43.312362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:43.312841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:43.313259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:43.342844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-25abc2f4-80b5-4ca9-9d43-0534534f7d63 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050620 Sep 05 14:48:43.343414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1062/2166] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:43.573207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:43.573791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:43.580197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:43.580674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:43.581104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:43.582400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:43.582890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:43.583320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:43.718222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:43.725900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-11f4185e-569e-4c04-baa3-36175f1a6166 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.156579 Sep 05 14:48:43.726480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1105/2167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:44.355798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:44.357864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:44.364733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:44.365202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:44.365627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:44.366342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:44.366808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:44.367234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:44.396082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7042763f-5fb0-4e29-8f71-d344ed784a5c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044871 Sep 05 14:48:44.396628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1063/2168] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:44.811059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:44.811675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:44.818128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:44.818605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:44.819064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:44.819743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:44.820194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:44.820613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:44.949602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:44.957833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-67dcc77c-7b39-463e-9a99-d8bbce58ecaa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.212238 Sep 05 14:48:44.958401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1106/2169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:45.408418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:45.410522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:45.416832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:45.417302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:45.417729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:45.418398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:45.418870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:45.419287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:45.447755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-21436600-e8a3-44f0-9614-be352b1cca8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 Sep 05 14:48:45.448287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1064/2170] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:45.980796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:45.981392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:45.987967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:45.988449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:45.988883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:45.989601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:45.990058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:45.990481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:46.120134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:46.128044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88157cb5-2cc9-4324-b7b3-cfd7295d65da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151391 Sep 05 14:48:46.128618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1107/2171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:45 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:46.460041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:46.462155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:46.468550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:46.469016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:46.469439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:46.470109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:46.470553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:46.471068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:46.499938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ff20544c-05e1-4b94-abed-42b177dc4930 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Sep 05 14:48:46.500492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1065/2172] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:47.150603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:47.151290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:47.157618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:47.158086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:47.158512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:47.159209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:47.159657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:47.160073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:47.287579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:47.295100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d37027c1-e0e4-47da-9166-606b59c36a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148298 Sep 05 14:48:47.295665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1108/2173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:47.512643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:47.514754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:47.521078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:47.521554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:47.521980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:47.522647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:47.523120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:47.523536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:47.551358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8781f900-77ef-4411-a30a-91298a2ad54a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042643 Sep 05 14:48:47.551887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1066/2174] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 14:48:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:48:48.318556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:48.319205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:48.325574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:48.326043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:48.326467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:48.327194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:48.327638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:48.328049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:48.460537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:48.468244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-49ee6391-a838-4f48-8312-b58e40b65d43 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153552 Sep 05 14:48:48.468799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1109/2175] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:48:48.563662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:48:48.565862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:48.572713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:48.573195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:48.573633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:48.574316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:48.574767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:48.575218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:48.671976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d537ab01-f4a9-463c-9165-41c6a6571d6b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action" status: 200 len: 82070 microversion: 2.1 time: 0.111875 Sep 05 14:48:48.672841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1067/2176] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 14:48:48 2022] POST /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/action => generated 82070 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 14:48:48.685744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:48.686229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:48.692109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:48.692580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:48.693506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:48.694171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:48.694615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:48.695058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:49.491390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:49.492081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:49.498969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:49.499445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:49.499876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:49.500554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:49.501288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:49.501720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:49.641175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:49.648720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-46b7fcbd-8f8d-4075-86a8-1303469a60e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.161567 Sep 05 14:48:49.649279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1068/2177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:50.673303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:50.674007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:50.680326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:50.680795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:50.681223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:50.681899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:50.682342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:50.682774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:50.813225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:50.821096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-72312132-30a4-4d4d-bc0d-b2770577d6e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.153431 Sep 05 14:48:50.822148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1069/2178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:51.844293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:51.844977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:51.851273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:51.851757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:51.852187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:51.852864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:51.853320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:51.853739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:51.981301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:51.989663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-10a92854-f5a1-4b5b-9201-3f8e7d18815d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.149209 Sep 05 14:48:51.990225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1070/2179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:53.013745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:53.014376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:53.020747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:53.021226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:53.021657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:53.022337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:53.022833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:53.023260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:53.162749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:53.170932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-15fa821a-fb9c-4b77-9e53-c8628579ca3c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.161097 Sep 05 14:48:53.171493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1071/2180] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:54.193594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:54.194226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:54.201118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:54.201592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:54.202021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:54.202698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:54.203171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:54.203586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:54.330605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:54.338218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-125ab3e3-2116-4fb4-8fa6-52a0edc499a6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.148552 Sep 05 14:48:54.338777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1072/2181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:55.361192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:55.361782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:55.368225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:55.368703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:55.369136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:55.370445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:55.370937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:55.371363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:55.497411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:55.505019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-719f893c-5113-473e-ae5d-808129c30e0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.147722 Sep 05 14:48:55.505571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1073/2182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:56.527726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:56.528375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:56.534728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:56.535232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:56.535660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:56.536332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:56.536778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:56.537194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:56.668074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:48:56.675795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1c7c4d75-87e1-47fe-9fc8-a2ae70bc1995 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.151939 Sep 05 14:48:56.676357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1074/2183] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:48:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:48:57.626954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:57.627515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:57.633913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:57.634525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:57.634831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:57.635516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:57.635966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:57.636872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:57.662009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:48:57.664812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:48:57.684026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lazy-loading 'services' on Instance uuid a50e765d-9688-493d-ac8c-fd4bf3bb5580 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:48:58.036989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-705b3bfd-372a-474c-b450-ab08a809ce4f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 204 len: 0 microversion: 2.1 time: 0.413550 Sep 05 14:48:58.037619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1075/2184] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:48:57 2022] DELETE /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 14:48:58.043691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:48:58.050158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:48:58.050158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:58.050477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:58.050948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:58.051639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:48:58.052089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:48:58.052511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:48:58.689430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=29 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:07.720845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=74 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:08.048836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:08.071125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=12,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:10.926441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Request method failure captured: Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments/81152632-7f7d-4c39-9601-23b15857f1b1 HTTP/1.1 Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgnSWAgLMZEA2Bbk0fuz4aZO8UUGIcv_bBK7qErgCTOrkv7pffmi8EoZHbUhjUPxVrBfvztULgJVmPuZfokJpf0sRy3GBofPrufy2G0j03ZVB7u3wYYGlzWZi6-_HLgyZVFaCUI9FJZBaKUPwGDVLdIRuVtmFoQ6lYZ4GC2Q_61_-Vs Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: e17efecb1ba44e69ac6b076e56ec9603 Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-TestMinimumBasicScenario-1151958227 Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:49:10.929093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e17efecb1ba44e69ac6b076e56ec9603"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/e17efecb1ba44e69ac6b076e56ec9603"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/e17efecb1ba44e69ac6b076e56ec9603"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_e17efecb1ba44e69ac6b076e56ec9603"}]}] Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-TestMinimumBasicScenario-1151958227 Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: e17efecb1ba44e69ac6b076e56ec9603 Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1151958227 Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-TestMinimumBasicScenario-1151958227-project Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 1a2d7c64ad9d44f997333ace9d4e60a1 Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-TestMinimumBasicScenario-1151958227-project Sep 05 14:49:10.930917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'server_id': 'a50e765d-9688-493d-ac8c-fd4bf3bb5580', 'id': '81152632-7f7d-4c39-9601-23b15857f1b1'} Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:49:10.932117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:49:10.934827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:10.936119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:49:10.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) Sep 05 14:49:10.939511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:10.940982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-8c0c586b-426d-436f-99fb-24cae1618b16) {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:49:10.940982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-87c19c69-b6ad-4def-8fa7-1a3d7b3ae2e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments/81152632-7f7d-4c39-9601-23b15857f1b1" status: 400 len: 269 microversion: 2.1 time: 22.248774 Sep 05 14:49:10.940982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1110/2185] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:48:48 2022] DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580/os-volume_attachments/81152632-7f7d-4c39-9601-23b15857f1b1 => generated 269 bytes in 22250 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 14:49:10.940982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:10.941350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:10.944851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:10.947936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:10.947936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:10.947936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:10.947936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:10.948328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:10.980573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'services' on Instance uuid 04bf5a93-4e3a-4291-afcd-c0213a44d540 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:49:11.096232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:11.104020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c4692c4-ffa8-42ca-9ffd-16a319897773 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.171943 Sep 05 14:49:11.104857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1111/2186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:11.109798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:11.110399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:11.116216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:11.116702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:11.117133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:11.117813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:11.118260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:11.118679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:11.134950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a HTTP/1.1 Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:49:11.136497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 14:49:11.138219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': 'dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a'} Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:49:11.139226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 14:49:11.140798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:49:11.142511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:49:11.142511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ad8fa653-2822-4b36-8810-c02fb23edf0b tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 404 len: 111 microversion: 2.1 time: 0.032106 Sep 05 14:49:11.142511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1112/2187] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:11 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:49:11.192902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-2a45f386-2b79-4f0a-a3c4-f6791757dafb req-43e277d0-1d43-44c3-a81e-b6c607f8e7a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a", "name": "network-vif-deleted", "tag": "4541f3e1-3407-4781-bb22-67bf97299fc8"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:11.202860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2a45f386-2b79-4f0a-a3c4-f6791757dafb req-43e277d0-1d43-44c3-a81e-b6c607f8e7a5 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:11.203341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2a45f386-2b79-4f0a-a3c4-f6791757dafb req-43e277d0-1d43-44c3-a81e-b6c607f8e7a5 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:11.203768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2a45f386-2b79-4f0a-a3c4-f6791757dafb req-43e277d0-1d43-44c3-a81e-b6c607f8e7a5 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:11.237108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-2a45f386-2b79-4f0a-a3c4-f6791757dafb req-43e277d0-1d43-44c3-a81e-b6c607f8e7a5 service nova] Creating event network-vif-deleted:4541f3e1-3407-4781-bb22-67bf97299fc8 for instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a on hv-cinder-84290 Sep 05 14:49:11.242149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-2a45f386-2b79-4f0a-a3c4-f6791757dafb req-43e277d0-1d43-44c3-a81e-b6c607f8e7a5 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.102658 Sep 05 14:49:11.242746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1113/2188] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:49:11.247704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ea16fbd0-b1ee-44de-b34d-7d51010d2ca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '.version_select at 0x7fb194bbbf70>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:11.251985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ea16fbd0-b1ee-44de-b34d-7d51010d2ca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [65e13fbe-b7b4-4191-99e7-1fb7e299bc34] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 14:49:12.259488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [None req-ea16fbd0-b1ee-44de-b34d-7d51010d2ca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [65e13fbe-b7b4-4191-99e7-1fb7e299bc34] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 50730. Sep 05 14:49:12.330919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ea16fbd0-b1ee-44de-b34d-7d51010d2ca1 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920009078" status: 202 len: 0 microversion: 2.1 time: 1.086868 Sep 05 14:49:12.331426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1114/2189] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 5 14:49:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1920009078 => generated 0 bytes in 1088 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:49:12.338331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:12.339199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:12.346369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:12.347077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:12.347697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:12.348590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:12.349211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:12.349829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:12.377355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:49:12.648650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2bc1b8b9-1703-4cf6-bbf6-e5d6fce5869c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "DELETE /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 204 len: 0 microversion: 2.1 time: 0.315946 Sep 05 14:49:12.652701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1115/2190] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:49:12 2022] DELETE /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:49:12.660939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:12.661644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:12.668220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:12.668700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:12.669362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:12.670064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:12.670511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:12.670994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:12.943453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:12.951437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a04198bf-daaf-4e35-8a2e-d7a910383f19 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.297133 Sep 05 14:49:12.965427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1116/2191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:13.221478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ceb55068-22da-44d5-849d-e8926b643c05 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: .version_select at 0x7fb194bbb9d0>, body: {"keypair": {"name": "tempest-keypair-750055755", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHubohvOUsseeoxvFGdhO8CpQcVEDc70PUJAvaXEBFvNducwtIpooZyTnA2IX071N8jZyxyK6QZMI7MTWxi9GT0gizOavnis0dmSFfpyHu/+oJtzItRofr9B2OxkcjyLsQ=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:13.238061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-ceb55068-22da-44d5-849d-e8926b643c05 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:49:13.242067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-ceb55068-22da-44d5-849d-e8926b643c05 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:49:13.358309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ceb55068-22da-44d5-849d-e8926b643c05 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.141141 Sep 05 14:49:13.363009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1117/2192] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 14:49:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:49:13.363909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-8ec577ca-d00b-4c72-9336-daece3cd1995 req-b5f585f7-b3f1-4c5e-8eb5-ff6ab750c1c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0921c73a-ed22-41a2-b38f-78c587836bb0", "tag": "5adb0041-9b7d-4fe6-9f1c-cb637443eb6e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:13.373708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8ec577ca-d00b-4c72-9336-daece3cd1995 req-b5f585f7-b3f1-4c5e-8eb5-ff6ab750c1c2 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:13.374273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8ec577ca-d00b-4c72-9336-daece3cd1995 req-b5f585f7-b3f1-4c5e-8eb5-ff6ab750c1c2 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:13.374705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8ec577ca-d00b-4c72-9336-daece3cd1995 req-b5f585f7-b3f1-4c5e-8eb5-ff6ab750c1c2 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:13.385259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-8ec577ca-d00b-4c72-9336-daece3cd1995 req-b5f585f7-b3f1-4c5e-8eb5-ff6ab750c1c2 service nova] Creating event network-changed:5adb0041-9b7d-4fe6-9f1c-cb637443eb6e for instance 0921c73a-ed22-41a2-b38f-78c587836bb0 on hv-cinder-84290 Sep 05 14:49:13.390549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-8ec577ca-d00b-4c72-9336-daece3cd1995 req-b5f585f7-b3f1-4c5e-8eb5-ff6ab750c1c2 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029457 Sep 05 14:49:13.392070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1118/2193] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:49:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:49:13.975853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:13.976559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:13.982937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:13.983994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:13.984583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:13.985148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:13.985601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:13.986023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:14.286386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:14.286386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0ffdfc81-290d-466b-b8ce-acd3f8ed6396 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1569 microversion: 2.1 time: 0.170361 Sep 05 14:49:14.286386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1119/2194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1569 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:15.166656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:15.167364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:15.174747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:15.175469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:15.175908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:15.176595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:15.177049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:15.177474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:15.311545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:15.319411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ca37752-09ac-4453-bdfd-49d3805fa522 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.156615 Sep 05 14:49:15.320185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1120/2195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:15.780984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-643779181", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b1d20ee-7dc0-477b-93a5-81201fa15bc2"}], "security_groups": [{"name": "tempest-securitygroup--1087427297"}], "key_name": "tempest-keypair-750055755", "user_data": "}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:15.881851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] validate_networks() for [('6b1d20ee-7dc0-477b-93a5-81201fa15bc2', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 14:49:16.296589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 14:49:16.297160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 14:49:16.297534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 14:49:16.297935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 14:49:16.298338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 14:49:16.307293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:16.307768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:16.308236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:16.308948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:16.309413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:16.309808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:16.326238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 14:49:16.330129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Getting quotas for user c078e655c9454316aa7afe13a6b565e7 and project 0f14cb621ef04aa3a17159e418d6c7aa. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 14:49:16.340885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 14:49:16.343806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 14:49:16.542118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c604a67d-abdd-4e04-a64b-7514f1a41d23 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.765976 Sep 05 14:49:16.542806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1121/2196] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 14:49:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 05 14:49:16.547796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:16.548334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:16.554369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:16.554881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:16.555308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:16.555987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:16.556436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:16.556850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:16.689363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:16.697539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-02c8772e-8443-45f6-ad70-17b238741976 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153387 Sep 05 14:49:16.698107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1122/2197] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:16.702954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-55e165eb-3fb7-4928-974a-15e923f24f6c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:16.703553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-55e165eb-3fb7-4928-974a-15e923f24f6c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:16.755196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-55e165eb-3fb7-4928-974a-15e923f24f6c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:16.761932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-55e165eb-3fb7-4928-974a-15e923f24f6c tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1240 microversion: 2.1 time: 0.062903 Sep 05 14:49:16.762506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1123/2198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:16 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1240 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:17.720551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:17.721244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:17.728230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:17.728706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:17.729135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:17.730072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:17.730517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:17.730973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:17.861106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:17.868734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b40b7a77-81a6-4731-9cd9-e28993c11bd6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152045 Sep 05 14:49:17.869305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1124/2199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:17.873558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e412f972-800a-4a84-affd-f9c805102120 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:17.874150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e412f972-800a-4a84-affd-f9c805102120 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:17.924615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e412f972-800a-4a84-affd-f9c805102120 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:17.931263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e412f972-800a-4a84-affd-f9c805102120 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1240 microversion: 2.1 time: 0.061057 Sep 05 14:49:17.931819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1125/2200] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:17 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1240 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:18.891932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:18.892540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:18.899523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:18.899999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:18.900424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:18.901095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:18.901543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:18.901954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:19.031191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:19.038761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e2c7dbf-2317-4c3a-b8b6-78538a3eaad7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151276 Sep 05 14:49:19.039331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1126/2201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:19.043620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b0841616-b8f3-4cf2-b3a9-99d05c8140dc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:19.044214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b0841616-b8f3-4cf2-b3a9-99d05c8140dc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:19.099632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b0841616-b8f3-4cf2-b3a9-99d05c8140dc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:19.106952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b0841616-b8f3-4cf2-b3a9-99d05c8140dc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1240 microversion: 2.1 time: 0.066612 Sep 05 14:49:19.107518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1127/2202] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:19 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1240 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:20.061228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:20.061904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:20.069125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:20.069603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:20.070030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:20.070709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:20.071181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:20.071598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:20.200978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:20.209429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f659a7d9-ff5f-4d48-8ca2-e38b4b004ff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152013 Sep 05 14:49:20.209984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1128/2203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:20.214384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c16c1d58-388f-4087-8f17-6c1b8722bffa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:20.215017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c16c1d58-388f-4087-8f17-6c1b8722bffa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:20.268291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c16c1d58-388f-4087-8f17-6c1b8722bffa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:20.275069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c16c1d58-388f-4087-8f17-6c1b8722bffa tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1240 microversion: 2.1 time: 0.064143 Sep 05 14:49:20.275622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1129/2204] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:20 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1240 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:20.991611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=4 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:21.234215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:21.234837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:21.241262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:21.241736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:21.242167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:21.242866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:21.243319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:21.243736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:21.373230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:21.380975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-021833e3-ce79-4519-8042-8554d8a8013d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151421 Sep 05 14:49:21.381564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1130/2205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:21.385901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:21.386505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:21.391976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:21.392461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:21.392905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:21.393609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:21.394064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:21.394489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:21.453675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:21.461140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b691f58d-2761-4f22-b2d9-ba45e0473f54 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1244 microversion: 2.1 time: 0.078650 Sep 05 14:49:21.461703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1131/2206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:21 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1244 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:22.403424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:22.404039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:22.411014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:22.411497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:22.411930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:22.412615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:22.413068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:22.413488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:22.544393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:22.552313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-665f6ee6-faaf-4a03-a080-40f49f0e2c3d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152716 Sep 05 14:49:22.552879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1132/2207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:22.557318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:22.557913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:22.563543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:22.564026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:22.564460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:22.565147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:22.565626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:22.566041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:22.630520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:22.638182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-32bf6f28-1888-4dc1-bc6b-a2e85f4176a4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1292 microversion: 2.1 time: 0.084377 Sep 05 14:49:22.639167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1133/2208] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:22 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:23.582123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:23.582748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:23.589454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:23.594409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:23.594409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:23.594409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:23.594409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:23.594863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:23.611790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:23.801801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:23.809531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6bc1fec9-9a79-4781-8ca2-9ff5aba53c0c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.232049 Sep 05 14:49:23.810162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1134/2209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:23.814654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:23.815286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:23.820944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:23.821731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:23.821931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:23.822618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:23.823099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:23.823522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:23.886022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:23.893892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e61fa143-1dd9-46c3-afb0-876727f70a94 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1298 microversion: 2.1 time: 0.082808 Sep 05 14:49:23.894445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1135/2210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:23 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1298 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:24.833482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:24.834158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:24.841725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:24.842214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:24.843289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:24.844003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:24.844464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:24.844893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:25.030369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:25.038192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf068958-c8d1-4e24-aece-18fb009a3dee tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.208833 Sep 05 14:49:25.038763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1136/2211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:24 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:25.043165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:25.043772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:25.049370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:25.049860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:25.050293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:25.051019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:25.051481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:25.051900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:25.182222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:25.190540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6f093651-9e9e-44f9-a09f-906c9a7a86a7 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.150770 Sep 05 14:49:25.191139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1137/2212] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:25 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:25.206850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-ec23c9b4-29d0-4fd4-a2d1-a6e3b019bb34 req-6f944cdb-4d08-4429-93b2-98c83f3cce06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f81a66-3708-4a39-976c-ad76174a0cfe", "tag": "23029087-5898-441d-a1d5-e195bd94e78e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:25.216594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ec23c9b4-29d0-4fd4-a2d1-a6e3b019bb34 req-6f944cdb-4d08-4429-93b2-98c83f3cce06 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:25.217150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ec23c9b4-29d0-4fd4-a2d1-a6e3b019bb34 req-6f944cdb-4d08-4429-93b2-98c83f3cce06 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:25.217605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-ec23c9b4-29d0-4fd4-a2d1-a6e3b019bb34 req-6f944cdb-4d08-4429-93b2-98c83f3cce06 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:25.228777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-ec23c9b4-29d0-4fd4-a2d1-a6e3b019bb34 req-6f944cdb-4d08-4429-93b2-98c83f3cce06 service nova] Creating event network-changed:23029087-5898-441d-a1d5-e195bd94e78e for instance 79f81a66-3708-4a39-976c-ad76174a0cfe on hv-cinder-84290 Sep 05 14:49:25.233846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-ec23c9b4-29d0-4fd4-a2d1-a6e3b019bb34 req-6f944cdb-4d08-4429-93b2-98c83f3cce06 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032694 Sep 05 14:49:25.234438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1138/2213] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:49:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:49:26.062686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:26.063374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:26.066341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:26.069837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:26.070319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:26.070780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:26.071489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:26.071943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:26.072365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:26.213334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:26.222603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-399fc859-b4da-463b-bfd8-452030a35057 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.164804 Sep 05 14:49:26.225813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1139/2214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:26.227528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:26.228127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:26.234360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:26.234867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:26.235297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:26.235968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:26.236417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:26.236833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:26.318646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:26.364654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:26.372180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-16bf026d-ab02-4955-9678-22994122033e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.148072 Sep 05 14:49:26.372742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1140/2215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:26 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:27.246084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:27.246703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:27.253643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:27.254113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:27.254544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:27.255243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:27.255721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:27.256140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:27.386583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:27.394401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-95a05ece-d1d8-4b17-a5d3-f390336b364a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152454 Sep 05 14:49:27.395026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1141/2216] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:27.399450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:27.400116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:27.406094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:27.406572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:27.407037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:27.407725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:27.408182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:27.408607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:27.534043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:27.541560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e03837b-f128-408c-a5f1-1b648211d4e0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.145608 Sep 05 14:49:27.542134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1142/2217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:27 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:28.417494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:28.418138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:28.425123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:28.425597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:28.426030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:28.426717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:28.427194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:28.427613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:28.617014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:28.625076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-59a7a528-7dab-447f-ac3c-52ef31c1dcf3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.211512 Sep 05 14:49:28.626219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1143/2218] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:28.630994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:28.631469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:28.637163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:28.637643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:28.638077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:28.638751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:28.639232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:28.639669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:28.977042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:28.985454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4c9794c4-b987-4bac-8520-24f24fbe45fd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.357641 Sep 05 14:49:28.998707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1144/2219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:28 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:49:29.650318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:29.651005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:29.657618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:29.658109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:29.658516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:29.659239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:29.659715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:29.660132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:29.799719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:29.807305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9d387ab1-bfe0-47c1-81f6-392dd6ac9ada tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.162218 Sep 05 14:49:29.807869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1145/2220] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:30.008820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:30.009472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:30.015436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:30.015922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:30.016355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:30.017041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:30.017498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:30.017921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:30.148223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:30.155769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-73e8c626-ec48-40bc-bbab-98666805c6a2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.150738 Sep 05 14:49:30.156327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1146/2221] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:30 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:30.830886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:30.831525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:30.833369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=18 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:30.838718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:30.841658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:30.841658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:30.841658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:30.841658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:30.842364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:30.971542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:30.979195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2a90e5b3-e9f9-4ebf-b528-08c3b5a65fcb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152770 Sep 05 14:49:30.979768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1147/2222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:31.178814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:31.179437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:31.185609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:31.186095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:31.186535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:31.187256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:31.188220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:31.188646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:31.319070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:31.326112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b336fe53-990c-41f2-a34d-20ddcc06c0d0 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.151434 Sep 05 14:49:31.326669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1148/2223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:31 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:31.606037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-27a25480-01f1-43ac-8bbe-1803f651fd05 req-5c9b3179-df62-4457-91e2-f8eb8eb90ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f81a66-3708-4a39-976c-ad76174a0cfe", "name": "network-vif-plugged", "status": "completed", "tag": "23029087-5898-441d-a1d5-e195bd94e78e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:31.615874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-27a25480-01f1-43ac-8bbe-1803f651fd05 req-5c9b3179-df62-4457-91e2-f8eb8eb90ffb service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:31.622416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-27a25480-01f1-43ac-8bbe-1803f651fd05 req-5c9b3179-df62-4457-91e2-f8eb8eb90ffb service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:31.622416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-27a25480-01f1-43ac-8bbe-1803f651fd05 req-5c9b3179-df62-4457-91e2-f8eb8eb90ffb service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:31.627899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-27a25480-01f1-43ac-8bbe-1803f651fd05 req-5c9b3179-df62-4457-91e2-f8eb8eb90ffb service nova] Creating event network-vif-plugged:23029087-5898-441d-a1d5-e195bd94e78e for instance 79f81a66-3708-4a39-976c-ad76174a0cfe on hv-cinder-84290 Sep 05 14:49:31.632843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-27a25480-01f1-43ac-8bbe-1803f651fd05 req-5c9b3179-df62-4457-91e2-f8eb8eb90ffb service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079999 Sep 05 14:49:31.633409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1149/2224] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:49:32.003024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:32.003982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:32.009990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:32.010466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:32.010925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:32.011667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:32.012116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:32.012530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:32.151597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:32.159422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-df1733fa-0603-4c6b-a23f-65854cfe6a3e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.161599 Sep 05 14:49:32.159985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1150/2225] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:32.349665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:32.350269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:32.356948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:32.357429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:32.357862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:32.358540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:32.359024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:32.359450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:32.484586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:32.494349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-21f66668-67e4-4c37-9b16-b84a2a069c52 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.148558 Sep 05 14:49:32.495829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1151/2226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:32 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:33.183952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:33.183952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:33.190664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:33.191171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:33.191601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:33.192282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:33.192729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:33.193150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:33.210760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:33.322770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:33.330632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3c63214-7c0d-4c06-9ad2-280e21fd7a94 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151743 Sep 05 14:49:33.331219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1152/2227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:33.518528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:33.519202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:33.525068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:33.525549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:33.525985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:33.526664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:33.527157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:33.527582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:33.657910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:33.665532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-912be882-1d2d-4f08-ba9f-b23a0a2e5fc8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1366 microversion: 2.1 time: 0.150702 Sep 05 14:49:33.666096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1153/2228] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:33 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:34.353552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:34.354230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:34.360728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:34.361205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:34.361640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:34.362327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:34.362779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:34.363226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:34.490904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:34.498480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-00d8907b-d8b0-461b-8465-8326eba9a08e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148938 Sep 05 14:49:34.499083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1154/2229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:34.690516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:34.691161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:34.697718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:34.698200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:34.698682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:34.699414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:34.699879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:34.700276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:34.832037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:34.839937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ebf7d250-174a-4451-a2c5-9a5e520565e4 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1555 microversion: 2.1 time: 0.153208 Sep 05 14:49:34.840816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1155/2230] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:34 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:34.863326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:34.863813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:34.869780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:34.870181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:34.870674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:34.875960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:34.875960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:34.875960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:34.949801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b8d36cc7-ea49-4f24-8668-7de71c66a86d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090235 Sep 05 14:49:34.950390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1156/2231] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 14:49:34 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:49:35.521888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:35.522742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:35.528643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:35.529125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:35.529562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:35.530249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:35.530716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:35.531154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:35.745567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:35.753390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-21082f28-a428-4bf5-a20a-842680325897 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.236091 Sep 05 14:49:35.753966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1157/2232] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:35.997914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-14c883d6-e7d1-4a7e-8ee9-c422a46ad12e req-9c5254e1-e25a-41c5-985c-5cc19d4de914 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "79f81a66-3708-4a39-976c-ad76174a0cfe", "tag": "23029087-5898-441d-a1d5-e195bd94e78e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:49:36.007301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-14c883d6-e7d1-4a7e-8ee9-c422a46ad12e req-9c5254e1-e25a-41c5-985c-5cc19d4de914 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:36.007761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-14c883d6-e7d1-4a7e-8ee9-c422a46ad12e req-9c5254e1-e25a-41c5-985c-5cc19d4de914 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:36.008183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-14c883d6-e7d1-4a7e-8ee9-c422a46ad12e req-9c5254e1-e25a-41c5-985c-5cc19d4de914 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:36.019320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-14c883d6-e7d1-4a7e-8ee9-c422a46ad12e req-9c5254e1-e25a-41c5-985c-5cc19d4de914 service nova] Creating event network-changed:23029087-5898-441d-a1d5-e195bd94e78e for instance 79f81a66-3708-4a39-976c-ad76174a0cfe on hv-cinder-84290 Sep 05 14:49:36.024245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-14c883d6-e7d1-4a7e-8ee9-c422a46ad12e req-9c5254e1-e25a-41c5-985c-5cc19d4de914 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030168 Sep 05 14:49:36.025018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1158/2233] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:49:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:49:36.777176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:36.777879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:36.784260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:36.784760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:36.785197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:36.785883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:36.786337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:36.786758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:36.931505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:36.939940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ca6c1f89-12a7-4cd5-92aa-3ab562a5b88f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.167480 Sep 05 14:49:36.940501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1159/2234] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:37.963281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:37.963919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:37.970839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:37.971322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:37.971762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:37.972443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:37.972893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:37.973322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:38.101106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:38.109035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-591c4d90-6fe7-44ee-8d6c-146d009cf635 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149829 Sep 05 14:49:38.109621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1160/2235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:39.132039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:39.132744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:39.139183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:39.139660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:39.140090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:39.140762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:39.141208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:39.141622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:39.267453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:39.275001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ea0e481-e0c8-4642-aee3-8c015c13f7cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.146808 Sep 05 14:49:39.275564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1161/2236] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:40.299635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:40.300274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:40.306745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:40.307263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:40.307703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:40.308394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:40.308848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:40.309278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:40.440231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:40.447868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3fd27e6-40b2-40ef-96aa-385336cb7b54 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152782 Sep 05 14:49:40.448439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1162/2237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:41.470908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:41.471600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:41.477950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:41.478431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:41.478899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:41.479560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:41.480003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:41.480687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:41.609021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:41.617615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e64ed42-3796-4bcf-85c6-a88f7a3f0adc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151121 Sep 05 14:49:41.618192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1163/2238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:42.640764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:42.641375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:42.647800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:42.648275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:42.648725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:42.649390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:42.649843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:42.650268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:42.780863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:42.788691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eb8783f9-850d-40fa-bef1-e71af296cd66 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151860 Sep 05 14:49:42.789259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1164/2239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:43.812281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:43.813510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:43.819841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:43.820324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:43.820758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:43.821476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:43.821930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:43.822357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:43.948985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:43.957340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-500bb205-6fa7-4e30-ba18-b6308055c9dc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148987 Sep 05 14:49:43.957896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1165/2240] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:44.980095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:44.980957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:44.987491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:44.987966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:44.988397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:44.989076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:44.989541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:44.989948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:45.122333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:45.130054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4bdad129-407d-40ae-acae-2a60c49f01d9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153910 Sep 05 14:49:45.130625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1166/2241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:46.153432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:46.154067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:46.160233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:46.160715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:46.161148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:46.161828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:46.162283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:46.162704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:46.295297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:46.302733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a753442a-451b-45b0-8382-dc3342c061b1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153224 Sep 05 14:49:46.303324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1167/2242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:47.109688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:49:47.110124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:49:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 (ip 10.222.0.15) !!! Sep 05 14:49:47.327043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:47.327559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:47.334411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:47.334932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:47.335368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:47.336049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:47.336503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:47.336924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:47.465104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:47.472795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6e0448eb-8a10-4c71-a59c-e67aba26ccab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149732 Sep 05 14:49:47.473367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1168/2243] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:48.495688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:48.496375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:48.502807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:48.503289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:48.503721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:48.504409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:48.504884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:48.505304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:48.635703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:48.643880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-466070a1-9763-41dd-bbe5-88eb7b172663 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152024 Sep 05 14:49:48.644447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1169/2244] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:49.667688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:49.668326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:49.675206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:49.675715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:49.676153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:49.676831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:49.677287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:49.677708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:49.681711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:49.806352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:49.814058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f07459c8-7795-406a-a4ea-a205fd48c46d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150293 Sep 05 14:49:49.814633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1170/2245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:50.837233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:50.837860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:50.844284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:50.844780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:50.845196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:50.845884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:50.846333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:50.846755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:50.977711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:50.985649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-797b0db7-d48c-46bf-9ffa-ace7f390ec95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152335 Sep 05 14:49:50.986214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1171/2246] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:52.009950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:52.010618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:52.016959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:52.017433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:52.017863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:52.018559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:52.019649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:52.020066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:52.153263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:52.160842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-314f254a-fcf9-4a7a-bedd-f4e330d5f474 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.154738 Sep 05 14:49:52.161406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1172/2247] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:53.183641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:53.184262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:53.190614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:53.191121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:53.191548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:53.192226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:53.192677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:53.193096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:53.323116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:53.330671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c3f7a9ec-4db3-476e-af2e-8e8831a1c931 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150895 Sep 05 14:49:53.331776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1173/2248] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:54.353405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:54.354042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:54.360956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:54.361429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:54.361855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:54.362526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:54.363011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:54.363428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:54.495657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:54.504213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ba0c2a3e-9815-409f-b7f5-201214844bb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.154050 Sep 05 14:49:54.507303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1174/2249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:55.527244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:55.527918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:55.534216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:55.534716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:55.535179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:55.535858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:55.536312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:55.536735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:55.665261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:55.672819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-063c2143-87c6-40c9-9392-c2ec730a9b63 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149492 Sep 05 14:49:55.673381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1175/2250] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:56.696861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:56.697509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:56.699744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=73 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:49:56.704345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:56.710861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:56.710861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:56.710861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:56.710861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:56.711284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:56.837832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:49:56.845530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8ca51d6d-e7bf-4823-8409-b9cb19a46426 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152547 Sep 05 14:49:56.846124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1176/2251] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:49:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:49:57.827378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:49:57.827966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:49:57.833748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:57.834231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:57.834664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:49:57.835375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:49:57.835827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:49:57.836250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:50:07.831684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:07.853823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=44 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:50:08.556429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:50:08.556900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 (ip 10.222.0.15) !!! Sep 05 14:50:58.073473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-caf5bcd7-dec7-4aa6-8f80-bb02585b01e5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34" status: 202 len: 0 microversion: 2.1 time: 120.034476 Sep 05 14:50:58.074391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1076/2252] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:48:58 2022] DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 => generated 0 bytes in 120036 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:50:58.080160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:50:58.080890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:50:58.088116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:50:58.088933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:50:58.088933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:50:58.089611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:50:58.094175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:50:58.094175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:50:58.225089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:50:58.232893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aaf9e489-fba3-4a78-afd6-5a38cdcd15e0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.157452 Sep 05 14:50:58.233432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1077/2253] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:50:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:50:58.238545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:50:58.239052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:50:58.244956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:50:58.245371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:50:58.245808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:50:58.246500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:50:58.247018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:50:58.247448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:50:58.277888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb910f07-487f-4566-8ad0-a2bd02e9a6bb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe/ips" status: 200 len: 148 microversion: 2.1 time: 0.043391 Sep 05 14:50:58.278463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1078/2254] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 14:50:58 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe/ips => generated 148 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:50:58.288298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'services' on Instance uuid 04bf5a93-4e3a-4291-afcd-c0213a44d540 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:50:58.289172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:50:58.289691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:50:58.297076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:50:58.297554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:50:58.298162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:50:58.298872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:50:58.299493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:50:58.299955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:08.293417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=4 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:08.293911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:08.318724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:11.681179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Request method failure captured: Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 HTTP/1.1 Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgozZPsKHxjOPwqtslNwY4Jd9oO5ciA_fZdBAQamDv20DYiWTAQ8MN84GP19-lIyUZDoxK25oPdAFVoZV1pp7eghy87ovpQoIfx1RqjPkpTkLw25avii7mAFmTFr-_LYW8T8S3RnRZsbTkViRWGrDgRy-CwKV0hQTeXOmhPlehrOHFQ Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:51:11.682758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f60d54b7dc874a8080159b81aafc89d5"}]}] Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: dac33ec33c26411d9dcf8c3bbea7a9e9 Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:51:11.684262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'server_id': '04bf5a93-4e3a-4291-afcd-c0213a44d540', 'id': '7a205cfe-8bed-498b-8df7-dca3d677be34'} Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:51:11.685363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:51:11.686556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:51:11.690744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:51:11.693462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) Sep 05 14:51:11.695565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:51:11.697933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-78481c39-10dc-4aae-8202-107247a417e1) {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:51:11.697933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f78f4bfe-e3a2-4992-a619-b172b3c0510a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34" status: 400 len: 269 microversion: 2.1 time: 73.984588 Sep 05 14:51:11.697933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1177/2255] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:49:57 2022] DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 => generated 269 bytes in 73986 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 14:51:11.697933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:11.698457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:11.699960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:11.700418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:11.700855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:11.701545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:11.702000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:11.702421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:11.786974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'services' on Instance uuid 04bf5a93-4e3a-4291-afcd-c0213a44d540 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:51:11.857429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:11.865049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4c7b8e21-6b17-4462-98a1-9e9262ab34e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.179224 Sep 05 14:51:11.865608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1178/2256] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:51:12.891247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:12.891868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:12.898534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:12.899057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:12.899517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:12.900204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:12.900695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:12.901145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:13.027401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:13.035049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8068f5e8-7d27-4c8d-9bb1-fffe892a3bc4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.147717 Sep 05 14:51:13.035615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1179/2257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:14.057953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:14.058630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:14.064880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:14.065357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:14.065786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:14.066627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:14.067101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:14.067518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:14.213886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:14.221603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4960342b-0f55-4074-8232-0b29d490cc7d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.168044 Sep 05 14:51:14.222165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1180/2258] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:15.245155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:15.245787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:15.252272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:15.252759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:15.253197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:15.253885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:15.254343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:15.254775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:15.383719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:15.391362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-daecc86e-31fa-42c1-b4de-242c61e0b78a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150701 Sep 05 14:51:15.391925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1181/2259] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:16.414942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:16.416130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:16.421867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:16.422345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:16.422810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:16.423504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:16.423951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:16.424368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:16.556017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:16.563817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a2ec55b6-4c59-4a41-93dc-e0cff24c9f35 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153032 Sep 05 14:51:16.564370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1182/2260] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:17.587011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:17.587710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:17.593915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:17.594394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:17.594850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:17.595540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:17.595993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:17.596416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:17.725463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:17.733357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0550371-1923-40d2-9e9e-35ceb3d2c85d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150255 Sep 05 14:51:17.733919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1183/2261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:18.756376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:18.757060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:18.763915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:18.764393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:18.764832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:18.765510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:18.765957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:18.766375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:18.897030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:18.905294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57470e8a-df6c-49b5-aaf8-942ec1207ee3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152742 Sep 05 14:51:18.905842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1184/2262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:19.928307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:19.928995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:19.935283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:19.935763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:19.936193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:19.936871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:19.937323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:19.937743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:20.067164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:20.074761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f75b412-272d-4328-8190-9ba081433123 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150278 Sep 05 14:51:20.075349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1185/2263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:21.097885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:21.098498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:21.105207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:21.105689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:21.106474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:21.107462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:21.107901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:21.108324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:21.242149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:21.251100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ad3b957f-8afe-425b-abf7-a318fd19798d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.157060 Sep 05 14:51:21.251661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1186/2264] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:21.793587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=4 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:22.273921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:22.274531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:22.281507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:22.281980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:22.282407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:22.283109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:22.283560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:22.283979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:22.414427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:22.422859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ce468a9-925d-4b73-9be1-066fe2d3f5e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152846 Sep 05 14:51:22.423415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1187/2265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:23.444749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:23.445501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:23.452285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:23.452763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:23.453189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:23.453865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:23.454311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:23.454729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:23.582379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:23.590034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3cf744d3-11ce-4450-8401-6be085ad6b79 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149169 Sep 05 14:51:23.590594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1188/2266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:24.613734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:24.614347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:24.620767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:24.624931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:24.624931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:24.624931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:24.624931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:24.625351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:24.750944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:24.758612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a1e57803-d559-4ce5-957b-de94b7f1ea42 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148729 Sep 05 14:51:24.759215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1189/2267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:24 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:25.781524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:25.782180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:25.788520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:25.788994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:25.789423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:25.790100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:25.790545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:25.791502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:25.923103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:25.930671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-60a9fbcc-06a3-4186-badf-db95963e1719 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152958 Sep 05 14:51:25.931263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1190/2268] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:26.954155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:26.954745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:26.961053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:26.965670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:26.965670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:26.965670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:26.965670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:26.966074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:27.093196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:27.100928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9be3e6d-307a-40a9-a5db-ed99bff400da tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150662 Sep 05 14:51:27.101489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1191/2269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:28.123837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:28.124443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:28.130812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:28.131301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:28.131734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:28.132408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:28.132856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:28.133350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:28.264920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:28.280698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-442eacd2-dab4-4438-8789-4448771eb541 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.160669 Sep 05 14:51:28.281277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1192/2270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:29.303979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:29.304605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:29.311048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:29.311529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:29.311962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:29.312638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:29.313088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:29.313506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:29.439482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:29.448045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-24368953-b0f6-4c5e-b444-a957fd5a04a1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.147364 Sep 05 14:51:29.448610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1193/2271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:30.470911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:30.471546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:30.477915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:30.478398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:30.478864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:30.479557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:30.480016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:30.480453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:30.498320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:30.612978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:30.621149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6d877e70-8c8a-4e3d-9f19-dcc29a89e66d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153723 Sep 05 14:51:30.621714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1194/2272] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:31.644703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:31.645371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:31.652524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:31.653004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:31.653431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:31.654113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:31.654564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:31.655009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:31.795778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:31.803474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-65fb24c7-7333-41c4-8e86-0735f17aa137 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.162657 Sep 05 14:51:31.804030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1195/2273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:32.827235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:32.827928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:32.834135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:32.834611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:32.835071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:32.835748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:32.836198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:32.836610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:32.970443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:32.978036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a557494-a257-42c7-a986-ffb88b832c61 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.154666 Sep 05 14:51:32.978591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1196/2274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:34.001163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:34.001865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:34.008182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:34.008655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:34.009085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:34.009751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:34.010196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:34.010610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:34.139942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:34.147732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d3ad20f7-5973-4d6d-8d54-3bc960093c18 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150403 Sep 05 14:51:34.148288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1197/2275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:35.171131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:35.171741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:35.178923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:35.179406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:35.179845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:35.180573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:35.181028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:35.181453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:35.315629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:35.323379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fbb171b2-05e2-4b0f-8597-587aa2ee5f8d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.156733 Sep 05 14:51:35.323950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1198/2276] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:36.345958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:36.346646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:36.353076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:36.353556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:36.353991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:36.354671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:36.355152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:36.358856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:36.484827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:36.492740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7fb298b6-31e5-4ebb-abfb-d6c23379a47e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150688 Sep 05 14:51:36.493300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1199/2277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:51:37.516730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:37.517461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:37.523681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:37.524156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:37.524581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:37.525254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:37.525698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:37.526116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:37.652905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:37.661020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c167a3ad-7024-4d4e-a874-83730a0253e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148696 Sep 05 14:51:37.661576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1200/2278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:38.684597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:38.685285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:38.687602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=47 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:38.692341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:38.692816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:38.693242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:38.693931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:38.694360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:38.694780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:38.829668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:38.837243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-852bdd8d-58a7-4ae2-8e83-5686ae6e0dae tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.156585 Sep 05 14:51:38.837799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1201/2279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:38 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:39.861060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:39.861779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:39.868096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:39.868575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:39.869013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:39.869691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:39.870142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:39.870561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:39.997945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:40.005632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ef8c6392-ab49-4a3b-a562-beecf4fc85e8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149226 Sep 05 14:51:40.006198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1202/2280] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:41.028434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:41.029076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:41.035587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:41.036069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:41.036504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:41.037185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:41.037637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:41.038061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:41.169545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:41.177877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1921235-a0ae-4cb8-986a-24c59621ebdf tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153289 Sep 05 14:51:41.178517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1203/2281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:42.201259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:42.201930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:42.210852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:42.211340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:42.212610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:42.213321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:42.213777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:42.214201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:42.346697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:42.354329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8a85c26-9e52-4c9f-abd6-9b1b8ebf72c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.157013 Sep 05 14:51:42.354920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1204/2282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:43.377095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:43.377759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:43.384150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:43.384620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:43.385047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:43.385716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:43.386161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:43.386582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:43.513143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:43.520879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b00f8603-7f04-459e-aa7d-07a9cd6befb3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148390 Sep 05 14:51:43.521435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1205/2283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:44.543441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:44.544117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:44.550456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:44.550963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:44.551389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:44.552058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:44.552505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:44.552919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:44.682186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:44.690350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2c52c3a6-7c46-4647-8166-61e288a583d1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150803 Sep 05 14:51:44.691000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1206/2284] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:45.713536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:45.714199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:45.720598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:45.721078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:45.721512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:45.722191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:45.722642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:45.723093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:45.850939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:45.858809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3dbb7199-f876-4cbe-85c6-1695c0309d74 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149151 Sep 05 14:51:45.859878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1207/2285] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:45 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:46.882089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:46.882748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:46.888960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:46.889444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:46.889883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:46.890567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:46.891053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:46.891480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:47.021869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:47.029517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a2454fa3-a0f1-4148-bc7e-230b6e56b5fa tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151913 Sep 05 14:51:47.030087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1208/2286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:48.052071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:48.052768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:48.059232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:48.059714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:48.060173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:48.060853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:48.061302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:48.061718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:48.190340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:48.197959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2f5f1e70-c356-4c3e-9698-01481a1a6e3a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149779 Sep 05 14:51:48.198516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1209/2287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:49.221844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:49.222488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:49.228837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:49.229309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:49.229736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:49.230409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:49.230891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:49.231309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:49.364144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:49.371726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-77952787-3398-4d4e-a97d-d180a4378cbc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.154275 Sep 05 14:51:49.372291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1210/2288] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:50.393495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:50.394124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:50.400474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:50.400951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:50.401384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:50.402061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:50.402513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:50.402965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:50.407337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:51:50.529557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:50.537649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9dddf811-a23d-4dba-a9fe-1a90e0c217d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148105 Sep 05 14:51:50.538206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1211/2289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:51.560949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:51.561613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:51.568574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:51.569049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:51.569477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:51.570153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:51.570601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:51.571047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:51.699646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:51.707259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d16b4873-d28e-4e7a-9f77-45bad43aaebb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150130 Sep 05 14:51:51.707847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1212/2290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:52.729541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:52.730178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:52.736750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:52.737221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:52.737643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:52.738312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:52.738757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:52.739209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:52.868380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:52.876624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5a9f237c-295a-4e91-acc9-3ffdd022b872 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151052 Sep 05 14:51:52.877199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1213/2291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:53.899922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:53.900613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:53.906977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:53.907464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:53.907894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:53.910958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:53.913585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:53.916198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:54.045158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:54.052774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a0f9b891-7e51-439b-9897-2b99274df61c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.156748 Sep 05 14:51:54.053332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1214/2292] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:55.075150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:55.075795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:55.082173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:55.082643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:55.083120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:55.083798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:55.084243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:55.084656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:55.217125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:55.225508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f353cde-68ea-46d3-b118-334d87d1c437 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.154265 Sep 05 14:51:55.226075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1215/2293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:56.249191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:56.249830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:56.256195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:56.256675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:56.257107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:56.257788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:56.258239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:56.258664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:56.388468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:56.396929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f44cac5f-4b36-4bc4-b959-f97d8c807b40 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.151594 Sep 05 14:51:56.406652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1216/2294] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:57.419953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:57.420572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:57.427026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:57.427505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:57.427931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:57.428608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:57.429052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:57.429465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:57.556000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:51:57.564230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4f51373-54c1-4c90-939c-18afedc3a444 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148113 Sep 05 14:51:57.564783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1217/2295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:51:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:51:57.821598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:51:57.822095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:51:57.828069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:57.828560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:57.828994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:51:57.829676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:51:57.830132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:51:57.830557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:07.825835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=35 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:52:07.848087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=44 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:52:58.598307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Request method failure captured: Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 HTTP/1.1 Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgozZPsKHxjOPwqtslNwY4Jd9oO5ciA_fZdBAQamDv20DYiWTAQ8MN84GP19-lIyUZDoxK25oPdAFVoZV1pp7eghy87ovpQoIfx1RqjPkpTkLw25avii7mAFmTFr-_LYW8T8S3RnRZsbTkViRWGrDgRy-CwKV0hQTeXOmhPlehrOHFQ Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:52:58.600648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f60d54b7dc874a8080159b81aafc89d5"}]}] Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: dac33ec33c26411d9dcf8c3bbea7a9e9 Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:52:58.602265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'server_id': '04bf5a93-4e3a-4291-afcd-c0213a44d540', 'id': '7a205cfe-8bed-498b-8df7-dca3d677be34'} Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:52:58.604110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:52:58.605461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.607174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:52:58.608605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) Sep 05 14:52:58.610437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.612128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-a0505d6a-e7ed-4387-9428-c5c0b69e2407) {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:52:58.612128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-74bcc964-ec0c-4441-852b-a3eb0631004f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34" status: 400 len: 269 microversion: 2.1 time: 120.322470 Sep 05 14:52:58.612128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1079/2296] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:50:58 2022] DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 => generated 269 bytes in 120323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 14:52:58.612128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:52:58.612524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:52:58.617009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:52:58.617490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:52:58.617921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:58.619271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:52:58.619733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:52:58.620156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:58.750264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:52:58.758168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1c8976c9-f001-4aac-afea-b89cb17b14f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153920 Sep 05 14:52:58.758735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1080/2297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:52:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:52:58.763744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:52:58.764235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:52:58.771290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:52:58.771690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'services' on Instance uuid 04bf5a93-4e3a-4291-afcd-c0213a44d540 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:52:58.772180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:52:58.772384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:58.773069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:52:58.773509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:52:58.774158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:58.960939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Request method failure captured: Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 HTTP/1.1 Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgozZPsKHxjOPwqtslNwY4Jd9oO5ciA_fZdBAQamDv20DYiWTAQ8MN84GP19-lIyUZDoxK25oPdAFVoZV1pp7eghy87ovpQoIfx1RqjPkpTkLw25avii7mAFmTFr-_LYW8T8S3RnRZsbTkViRWGrDgRy-CwKV0hQTeXOmhPlehrOHFQ Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 14:52:58.963712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f60d54b7dc874a8080159b81aafc89d5"}]}] Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: dac33ec33c26411d9dcf8c3bbea7a9e9 Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:52:58.965373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'server_id': '04bf5a93-4e3a-4291-afcd-c0213a44d540', 'id': '7a205cfe-8bed-498b-8df7-dca3d677be34'} Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:52:58.966502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:52:58.967886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.969379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:52:58.970722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) Sep 05 14:52:58.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 14:52:58.973537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3b2cab3f-c221-4d34-9e3d-a543680f63ee) {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:52:58.973537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f7a75da8-b87d-4eec-a417-85a3c0bfdbe4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34" status: 400 len: 269 microversion: 2.1 time: 61.148806 Sep 05 14:52:58.973537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1218/2298] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:51:57 2022] DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 => generated 269 bytes in 61151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 14:52:58.973537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:52:58.973911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:52:58.980639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:52:58.981098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:52:58.981529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:58.982205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:52:58.982653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:52:58.983113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:52:59.011265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lazy-loading 'services' on Instance uuid 04bf5a93-4e3a-4291-afcd-c0213a44d540 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 14:52:59.072296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Request method failure captured: Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 HTTP/1.1 Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgozZPsKHxjOPwqtslNwY4Jd9oO5ciA_fZdBAQamDv20DYiWTAQ8MN84GP19-lIyUZDoxK25oPdAFVoZV1pp7eghy87ovpQoIfx1RqjPkpTkLw25avii7mAFmTFr-_LYW8T8S3RnRZsbTkViRWGrDgRy-CwKV0hQTeXOmhPlehrOHFQ Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:52:59.074508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/f60d54b7dc874a8080159b81aafc89d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_f60d54b7dc874a8080159b81aafc89d5"}]}] Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: f60d54b7dc874a8080159b81aafc89d5 Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1878134250 Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: dac33ec33c26411d9dcf8c3bbea7a9e9 Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesSnapshotTestJSON-1878134250-project Sep 05 14:52:59.080133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'server_id': '04bf5a93-4e3a-4291-afcd-c0213a44d540', 'id': '7a205cfe-8bed-498b-8df7-dca3d677be34'} Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:52:59.081164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5194, in _detach_volume Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 14:52:59.082520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:59.084071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5216, in detach_volume Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 231, in wrapped Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5196, in _detach_volume Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:52:59.085946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) Sep 05 14:52:59.088104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:52:59.095433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-d3f6868d-4921-44b7-8235-0cf81a8c40ee) {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:52:59.095433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-89622eb4-b136-44df-919a-56d595266ecd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34" status: 400 len: 269 microversion: 2.1 time: 0.317476 Sep 05 14:52:59.095433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1081/2299] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 14:52:58 2022] DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540/os-volume_attachments/7a205cfe-8bed-498b-8df7-dca3d677be34 => generated 269 bytes in 323 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 14:52:59.130626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:52:59.138998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8bda57fe-feb4-44b6-a517-92d469339f60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.170221 Sep 05 14:52:59.139566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1219/2300] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:52:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:00.161772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:00.162382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:00.168910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:00.169393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:00.169827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:00.170506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:00.170995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:00.171419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:00.303097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:00.310877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1cd54d40-3948-4868-987b-87fc0ebdbe73 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153409 Sep 05 14:53:00.311431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1082/2301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:01.332988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:01.333595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:01.340058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:01.340531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:01.340958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:01.341630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:01.342078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:01.342496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:01.471415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:01.479222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-82fec3dd-9876-4ea1-aa90-7bfc100fd0bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150029 Sep 05 14:53:01.480264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1220/2302] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:02.503389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:02.504283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:02.510375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:02.510959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:02.511399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:02.512086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:02.513120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:02.513545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:02.644426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:02.652112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-64e8df3e-cf01-4470-9e83-79cbba162cda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152684 Sep 05 14:53:02.652669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1083/2303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:03.674818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:03.675424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:03.681810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:03.682292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:03.682726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:03.683449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:03.683902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:03.684320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:03.812841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:03.820438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a62674d6-2bd5-4bac-a85d-9f07eaf51b64 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.149664 Sep 05 14:53:03.821012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1221/2304] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:04.844545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:04.845180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:04.851597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:04.852071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:04.852501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:04.853171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:04.853617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:04.854029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:04.981946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:04.990163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0011053c-a683-4570-a433-e549fd520958 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.150215 Sep 05 14:53:04.990719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1084/2305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:06.013070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:06.013662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:06.020131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:06.020614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:06.021051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:06.021739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:06.022192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:06.022645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:06.154225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:06.162099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8739d063-b405-4a04-924e-cb0e5925dff6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153491 Sep 05 14:53:06.162655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1222/2306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:07.185507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:07.186109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:07.188784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:53:07.188924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:53:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:53:07.199242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:07.200366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:07.200806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:07.201487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:07.201934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:07.202350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:07.332800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:07.340504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8d991895-bf7c-422a-84c5-36b868da8b6b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.159619 Sep 05 14:53:07.341064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1085/2307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:08.362967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:08.363511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:08.369984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:08.370569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:08.371037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:08.371710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:08.372167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:08.372588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:08.504446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:08.512762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d49ef7eb-b9bd-4644-9c3a-05fc2835ea65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.153294 Sep 05 14:53:08.513321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1223/2308] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:09.534837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:09.535443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:09.541817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:09.542238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:09.542666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:09.543992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:09.544439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:09.544857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:09.672275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:09.679929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e4011f2b-2638-4adb-b586-7b525cdd2f93 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.148943 Sep 05 14:53:09.680738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1086/2309] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:10.702518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:10.703175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:10.709559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:10.710041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:10.710474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:10.711191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:10.711644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:10.712063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:10.843317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:10.850902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c0241a0c-dd1b-4f54-9d27-983a60946021 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.152212 Sep 05 14:53:10.851472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1224/2310] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:11.876423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:11.877028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:11.883325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:11.883796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:11.884219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:11.884891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:11.885341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:11.885761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:12.022376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:12.030559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b1f3c8a1-5cb3-44cc-85da-e11c3ac60452 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1451 microversion: 2.1 time: 0.158566 Sep 05 14:53:12.046521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1087/2311] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1451 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:13.020443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-c00a63b1-91bb-4250-be8d-3a3aebf343a2 req-6e61e723-cbd4-4cbb-b7e5-4268a1cdad46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0921c73a-ed22-41a2-b38f-78c587836bb0", "name": "network-vif-deleted", "tag": "5adb0041-9b7d-4fe6-9f1c-cb637443eb6e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:53:13.038718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-c00a63b1-91bb-4250-be8d-3a3aebf343a2 req-6e61e723-cbd4-4cbb-b7e5-4268a1cdad46 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:13.039318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-c00a63b1-91bb-4250-be8d-3a3aebf343a2 req-6e61e723-cbd4-4cbb-b7e5-4268a1cdad46 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:13.039975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-c00a63b1-91bb-4250-be8d-3a3aebf343a2 req-6e61e723-cbd4-4cbb-b7e5-4268a1cdad46 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:13.055153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:13.055153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:13.061526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:13.061922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:13.062367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:13.068203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-c00a63b1-91bb-4250-be8d-3a3aebf343a2 req-6e61e723-cbd4-4cbb-b7e5-4268a1cdad46 service nova] Creating event network-vif-deleted:5adb0041-9b7d-4fe6-9f1c-cb637443eb6e for instance 0921c73a-ed22-41a2-b38f-78c587836bb0 on hv-cinder-84290 Sep 05 14:53:13.071722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:13.072722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:13.073361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:13.080219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-c00a63b1-91bb-4250-be8d-3a3aebf343a2 req-6e61e723-cbd4-4cbb-b7e5-4268a1cdad46 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.063663 Sep 05 14:53:13.083869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1225/2312] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 14:53:13.173385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:13.182704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c34dfa6c-8d67-44dd-a67c-692abcab6044 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1377 microversion: 2.1 time: 0.133110 Sep 05 14:53:13.184495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1088/2313] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1377 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:14.208486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:14.209257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:14.215428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:14.215916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:14.216349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:14.217040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:14.217561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:14.218494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:14.280728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:14.289567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a2386e6c-12b9-47a7-941e-6f6188b17155 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085793 Sep 05 14:53:14.290545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1226/2314] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:14 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:15.311976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:15.312579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:15.318637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:15.319143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:15.319577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:15.320248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:15.320694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:15.321117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:15.381407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:15.388956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8fd879e0-8f33-44c7-8407-a1b7ffb8e5e7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080933 Sep 05 14:53:15.389508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1089/2315] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:53:16.411427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:16.411956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:16.418436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:16.418953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:16.419394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:16.420082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:16.421032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:16.421456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:16.483489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:16.492045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-351787b6-fca6-4d6a-a805-b670fe53f73d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084678 Sep 05 14:53:16.492624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1227/2316] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:17.516523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:17.517134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:17.523682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:17.524154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:17.524581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:17.525261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:17.525723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:17.526129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:17.587478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:17.595304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-074a0f3a-c3e4-4ddc-8ee3-e99951e4bbb1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083299 Sep 05 14:53:17.595863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1090/2317] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:18.617074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:18.617712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:18.624446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:18.624922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:18.625351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:18.626025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:18.626472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:18.626912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:18.689801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:18.697907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-41f73504-b5d9-4488-96ae-f5df9521743d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084744 Sep 05 14:53:18.698492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1228/2318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:19.728140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:19.728732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:19.731127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:53:19.731270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:53:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:53:19.737985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:19.738467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:19.738920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:19.739606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:19.740059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:19.740480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:19.800903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:19.808441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-20ef3e7a-e0cc-41e3-adec-4d3f327b56b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084244 Sep 05 14:53:19.809004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1091/2319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:20.831926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:20.832544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:20.839163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:20.839643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:20.840188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:20.840874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:20.841327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:20.841748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:20.904188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:20.912428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2d8b81f5-244a-410a-987d-ae4311f7a44f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084351 Sep 05 14:53:20.913146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1229/2320] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:53:21.935224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:21.935827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:21.942177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:21.942650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:21.943109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:21.943804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:21.944252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:21.944669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:21.948476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=75 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:53:22.007325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:22.015029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-05bb2c22-f8d5-4a3e-9df4-48b944094d65 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083540 Sep 05 14:53:22.015586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1092/2321] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:23.039188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:23.039731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:23.046655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:23.047168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:23.047602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:23.048285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:23.048737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:23.049160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:23.110135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:23.117779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8ce0a4f-c0d9-4270-90a7-c2898c6534ec tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082540 Sep 05 14:53:23.118336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1230/2322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:24.140911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:24.141562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:24.147948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:24.148425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:24.148852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:24.149535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:24.149984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:24.150458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:24.210459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:24.218327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e9641d01-e598-4f7f-b7b3-3d60157c0d6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081913 Sep 05 14:53:24.218923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1093/2323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:24 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:25.241539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:25.242180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:25.248612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:25.249102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:25.249544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:25.250237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:25.250693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:25.251149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:25.313132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:25.320756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-50917e27-0a08-497c-ae1b-f08a8fb3ae14 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083174 Sep 05 14:53:25.321318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1231/2324] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:26.343862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:26.344461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:26.350928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:26.351360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:26.351795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:26.352486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:26.352936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:26.353357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:26.414074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:26.422379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d79cc669-0a67-4788-9d9e-916196679b0d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081712 Sep 05 14:53:26.422994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1094/2325] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:27.444146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:27.444756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:27.451215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:27.451695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:27.452128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:27.452834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:27.453288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:27.453711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:27.513369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:27.521518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6382964-1921-44d6-a115-0316d399af6f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081300 Sep 05 14:53:27.522079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1232/2326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:28.544562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:28.545171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:28.548171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=31 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:53:28.552806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:28.560061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:28.560061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:28.560061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:28.560061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:28.560527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:28.571233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:53:28.571419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:53:28.638012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:28.645756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a3e8dfca-9d72-4de5-95e2-7dbe1a18ece9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.105088 Sep 05 14:53:28.646317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1095/2327] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:29.668645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:29.669254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:29.671655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=29 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:53:29.676474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:29.676960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:29.677392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:29.678149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:29.678602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:29.679058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:29.682985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=85 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:53:29.740539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:29.748080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6cbf1949-525d-445d-8976-23177cd97596 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083294 Sep 05 14:53:29.748635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1233/2328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:30.771449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:30.772084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:30.778403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:30.778901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:30.779331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:30.780006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:30.780451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:30.780869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:30.841192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:30.849417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c9525082-8f68-47e0-868a-612419faced4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081830 Sep 05 14:53:30.849964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1096/2329] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:31.872056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:31.872697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:31.879035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:31.879521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:31.879955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:31.880637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:31.881092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:31.881516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:31.944377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:31.952015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f0b8ee1-f802-4efe-b9a2-81dbda0a2451 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083848 Sep 05 14:53:31.952580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1234/2330] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:53:32.974195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:32.974835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:32.981146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:32.981619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:32.982049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:32.982720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:32.983197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:32.983615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:33.043768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:33.051827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ca00a160-9fc9-40e4-9902-e8da9b2b862f tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081535 Sep 05 14:53:33.052384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1097/2331] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:34.075277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:34.075919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:34.083232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:34.083709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:34.084141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:34.084823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:34.085272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:34.085689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:34.149443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:34.157083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6f6d0b9-eec0-47eb-98ad-27b57f58631d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085623 Sep 05 14:53:34.157630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1235/2332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:35.179335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:35.179945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:35.186136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:35.186623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:35.187076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:35.187760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:35.188214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:35.188636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:35.250159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:35.257887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b46bc334-35bf-45dd-af7b-446cb8fbca45 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082378 Sep 05 14:53:35.259650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1098/2333] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:35 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:36.280901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:36.281534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:36.288313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:36.288818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:36.289248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:36.289920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:36.290366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:36.290805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:36.354543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:36.363261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6b35a88e-38d9-4b9c-817e-41997f53c45a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.086205 Sep 05 14:53:36.363819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1236/2334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:37.385373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:37.386009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:37.392449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:37.392934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:37.393363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:37.394078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:37.394527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:37.394989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:37.457579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:37.465155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-51275320-9678-4b63-a3ef-fd8f82353a23 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083660 Sep 05 14:53:37.465714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1099/2335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:38.487995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:38.488596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:38.495142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:38.495622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:38.496047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:38.496720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:38.497166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:38.497588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:38.557538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:38.565703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07380671-d67b-4c37-964f-ab2af024d5cb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081905 Sep 05 14:53:38.566253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1237/2336] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:38 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:39.588435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:39.589186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:39.595594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:39.596102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:39.596534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:39.597214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:39.597663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:39.598662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:39.658375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:39.666560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bfbe424c-2585-473a-876c-ed591f8ae47c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082170 Sep 05 14:53:39.667161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1100/2337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:40.689722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:40.690315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:40.696819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:40.697296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:40.697724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:40.698399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:40.698870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:40.699290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:40.769512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:40.777504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4607c8d1-c02f-4556-adeb-a5a854e261df tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.092498 Sep 05 14:53:40.778067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1238/2338] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:41.800631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:41.801276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:41.807717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:41.808176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:41.808612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:41.809295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:41.809743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:41.810165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:41.877355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:41.885005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c80fd8f2-5770-4c7e-aa0a-1111af19e994 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.088330 Sep 05 14:53:41.885561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1101/2339] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:42.907737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:42.908371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:42.914956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:42.915433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:42.915863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:42.916534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:42.916983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:42.917398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:42.977765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:42.985557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-489c612d-615e-4502-89f6-046dc356ad24 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081682 Sep 05 14:53:42.986111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1239/2340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:44.007595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:44.008205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:44.014298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:44.014776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:44.015242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:44.015924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:44.016379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:44.016801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:44.082988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:44.086133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0a0266ee-7104-45e0-aa1d-94638dbcd565 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082381 Sep 05 14:53:44.086695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1102/2341] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:45.270273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:45.270908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:45.276664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:45.277137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:45.277562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:45.278238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:45.278686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:45.279129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:45.341502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:45.349092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2663952c-2021-4326-9f53-ce7ec48cee21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.243676 Sep 05 14:53:45.349748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1240/2342] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:45 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:46.371617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:46.372209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:46.378553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:46.379069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:46.379505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:46.380188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:46.380638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:46.381059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:46.441267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:46.448864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0573948f-daef-4b75-aa34-4e4dec4fed50 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081161 Sep 05 14:53:46.449425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1103/2343] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:46 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:47.471842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:47.472464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:47.479050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:47.479530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:47.479967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:47.480646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:47.481098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:47.481519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:47.544131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:47.552357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee65b23e-5005-4869-80d2-b9106aefdc2e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084414 Sep 05 14:53:47.552919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1241/2344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:48.574775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:48.575426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:48.581735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:48.582207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:48.582636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:48.583335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:48.583782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:48.584195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:48.644129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:48.651763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f4a7a78f-920e-4512-93af-cb63e12bb940 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080867 Sep 05 14:53:48.652319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1104/2345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:49.674173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:49.674781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:49.681284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:49.681767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:49.682202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:49.682913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:49.683366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:49.683785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:49.747750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:49.755797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aaa36e5c-16a7-42a0-8559-5fcb585a0925 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085580 Sep 05 14:53:49.756353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1242/2346] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:50.778085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:50.778681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:50.785208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:50.785687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:50.786122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:50.787449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:50.787900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:50.788321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:50.849634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:50.857328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-559862ec-1b1f-449e-9434-694a4fc8ad33 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083160 Sep 05 14:53:50.857890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1105/2347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:51.880248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:51.880861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:51.887214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:51.887698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:51.888137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:51.888816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:51.889269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:51.889690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:51.951138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:51.958760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-346962a3-24dc-474b-b1a5-625647a761ce tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082492 Sep 05 14:53:51.959357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1243/2348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:52.981549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:52.982162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:52.988900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:52.989398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:52.989828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:52.990506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:52.990998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:52.991420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:52.993915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=84 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:53:53.054174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:53.061660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-030c1a08-6cc7-4d05-95e4-db8026c13b7e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084012 Sep 05 14:53:53.062220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1106/2349] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:54.084701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:54.084701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:54.090974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:54.091465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:54.091899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:54.092591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:54.093048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:54.093474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:54.158456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:54.166910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-75f7142a-e814-429c-90a6-042853431a15 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.086786 Sep 05 14:53:54.167475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1244/2350] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:53:55.189429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:55.190043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:55.196564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:55.197044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:55.197478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:55.198163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:55.198614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:55.199069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:55.259548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:55.267099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-27438ef3-257d-45ae-bed7-c60945d410fb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081554 Sep 05 14:53:55.267659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1107/2351] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:55 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:56.290696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:56.291346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:56.297744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:56.298228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:56.298662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:56.299370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:56.299824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:56.300271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:56.360274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:56.368611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2592009c-7cf4-470b-85d5-7b4e7843bfe6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081660 Sep 05 14:53:56.369168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1245/2352] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:57.391155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:57.391779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:57.398229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:57.398714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:57.399189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:57.399874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:57.400332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:57.400756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:57.461115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:57.468810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-78a453b0-60a4-4c55-b300-11add5cbce89 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081532 Sep 05 14:53:57.469374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1108/2353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:58.491707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:58.492321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:58.498715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:58.499232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:58.499669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:58.500346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:58.500804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:58.501223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:58.564339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:58.572440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1f7e72b-e85a-4539-9fde-cff25e2612cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084127 Sep 05 14:53:58.572999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1246/2354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:53:59.595758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:53:59.596367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:53:59.598628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=28 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:53:59.603857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:59.604325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:59.604749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:59.605434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:53:59.605880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:53:59.606299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:53:59.667611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:53:59.675098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3e7cff9-e724-4400-b71b-0b25f1aacfcd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083142 Sep 05 14:53:59.675679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1109/2355] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:53:59 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:00.697943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:00.698588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:00.700959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=28 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:00.705641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:00.706118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:00.706552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:00.707278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:00.707731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:00.708154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:00.712070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=84 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:00.769699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:00.778134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-67bdf125-f3b6-409c-9911-a0959dead881 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084585 Sep 05 14:54:00.778700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1247/2356] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:01.800399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:01.801023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:01.807504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:01.808771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:01.808771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:01.809062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:01.809513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:01.809934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:01.870384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:01.878001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83f39ed3-bb04-42fc-bf44-6cff0614206a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081506 Sep 05 14:54:01.878589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1110/2357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:02.900521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:02.901430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:02.907748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:02.908222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:02.908650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:02.909321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:02.909769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:02.910181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:02.974553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:02.982853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-23264bc3-7443-4dbc-b78d-81795ab234f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.086200 Sep 05 14:54:02.983404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1248/2358] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:04.006175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:04.006810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:04.013732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:04.014206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:04.014634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:04.015347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:04.015793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:04.016208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:04.080891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:04.084615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ec7308ec-a271-4013-af7f-3b09a4c2d1c3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082381 Sep 05 14:54:04.085186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1111/2359] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:05.107665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:05.108276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:05.114942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:05.115422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:05.115853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:05.116531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:05.116982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:05.117402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:05.177479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:05.185092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5e76f765-431e-4235-8e82-ba2f8a21c31d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082044 Sep 05 14:54:05.188430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1249/2360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:05 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:06.207814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:06.208425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:06.215505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:06.215987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:06.216420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:06.217102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:06.217560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:06.217985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:06.279884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:06.287409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-61e4a7bd-6ce7-492e-946c-6cf4012397f0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083443 Sep 05 14:54:06.287970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1112/2361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:07.310012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:07.310554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:07.317068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:07.317544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:07.317975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:07.318651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:07.319127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:07.319585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:07.382741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:07.391355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-77f74262-edd3-4783-9842-78f2ad5b424d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085499 Sep 05 14:54:07.391921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1250/2362] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:08.413427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:08.413998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:08.420831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:08.421301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:08.421728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:08.422423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:08.422900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:08.423317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:08.483536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:08.491247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3fdbe03e-3f99-4ab0-993d-f834ae636992 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081665 Sep 05 14:54:08.491805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1113/2363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:09.515003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:09.515596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:09.521885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:09.522361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:09.522811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:09.523477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:09.523924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:09.524347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:09.583822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:09.591741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fb89ba18-6e88-4230-bbaf-84aa210181cc tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081352 Sep 05 14:54:09.592292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1251/2364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:10.615163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:10.615803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:10.622119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:10.622595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:10.623062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:10.623740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:10.624188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:10.624608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:10.684887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:10.692441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2fd5a73c-2140-412c-9817-b4de87981e80 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081187 Sep 05 14:54:10.692997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1114/2365] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:11.715897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:11.716479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:11.722952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:11.723427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:11.723889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:11.724561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:11.725011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:11.725423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:11.788700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:11.797000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ad25b234-e336-4323-8c37-e10677f95448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085617 Sep 05 14:54:11.798107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1252/2366] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:12.819165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:12.819779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:12.826782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:12.827287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:12.827719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:12.828396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:12.828847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:12.829265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:12.889199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:12.896728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-12d7e48e-84b8-4ae2-9f35-bb160988beb4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081528 Sep 05 14:54:12.897274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1115/2367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:13.919517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:13.920128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:13.926503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:13.927017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:13.927468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:13.928132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:13.928585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:13.929022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:14.060995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:14.068850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-38d0ddc9-6880-47f8-9273-2c84c62c9588 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.153193 Sep 05 14:54:14.069412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1253/2368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:13 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:15.092362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:15.092970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:15.099090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:15.099551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:15.099978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:15.100657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:15.101111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:15.101513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:15.161343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:15.168862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c65777a7-40e2-42ea-a76f-f30b608854bd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081058 Sep 05 14:54:15.169414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1116/2369] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:15 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:16.191255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:16.191870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:16.197985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:16.198496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:16.198965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:16.199653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:16.200109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:16.200533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:16.265565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:16.273119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ef953ffd-21ff-4269-9024-5149ab4ab491 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085718 Sep 05 14:54:16.273675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1254/2370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:16 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:17.296377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:17.296946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:17.303481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:17.303949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:17.304386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:17.305071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:17.305529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:17.305984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:17.367516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:17.375871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-757e9b90-dd00-4911-9a9c-05d265fb7990 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083986 Sep 05 14:54:17.376436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1117/2371] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:17 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:18.397828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:18.398401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:18.405154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:18.405627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:18.406052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:18.406722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:18.407195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:18.407616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:18.467091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:18.474714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ec874fbb-535f-4033-a5e8-01dc53803690 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080891 Sep 05 14:54:18.475304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1255/2372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:18 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:19.498065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:19.498668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:19.505115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:19.505589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:19.506017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:19.506693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:19.507167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:19.507593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:19.568237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:19.576411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8773681f-0155-4426-8f34-9d311bb4b527 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082375 Sep 05 14:54:19.576961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1118/2373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:19 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:20.599626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:20.600234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:20.607208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:20.607680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:20.608109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:20.608812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:20.609263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:20.609680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:20.672406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:20.680080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5eb4ee1e-a285-426d-bea5-fc285b74e482 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084327 Sep 05 14:54:20.680633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1256/2374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:20 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:21.703357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:21.703988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:21.710370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:21.710939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:21.711374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:21.712054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:21.712504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:21.712926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:21.786365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:21.794698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e39945cd-5a26-4fbd-8948-cb361aad1bea tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.095192 Sep 05 14:54:21.795307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1119/2375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:21 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:22.817582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:22.818121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:22.825562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:22.826044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:22.826480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:22.827194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:22.827676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:22.828098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:22.888996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:22.896572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e360f290-03fe-4f8f-9a08-4322162d0a8c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082974 Sep 05 14:54:22.897132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1257/2376] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:22 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:23.919051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:23.919664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:23.926139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:23.926618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:23.927083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:23.927763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:23.928221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:23.928634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:23.931137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=84 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:23.989572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:23.997113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b99b564f-2a8d-4f1b-8398-72de4f620edd tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082053 Sep 05 14:54:23.997669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1120/2377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:23 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:25.019776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:25.020379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:25.022751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:54:25.022909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:54:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:54:25.029258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:25.029730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:25.030156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:25.030856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:25.031311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:25.031727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:25.095304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:25.102999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-58b32474-3cda-490f-921a-6bfce481886d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.087052 Sep 05 14:54:25.103553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1258/2378] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:25 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:26.125591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:26.126237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:26.132705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:26.133188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:26.133622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:26.134307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:26.134759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:26.135208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:26.195291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:26.203409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e70460dd-4703-4f8c-a71d-024e77b285f4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081805 Sep 05 14:54:26.203973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1121/2379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:26 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:54:27.226602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:27.227253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:27.234262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:27.234739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:27.235198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:27.236134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:27.236589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:27.237000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:27.297663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:27.305333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6afac5d8-7127-4187-a56e-e707e8e95c21 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082730 Sep 05 14:54:27.305893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1259/2380] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:27 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:28.328426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:28.329217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:28.335715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:28.336334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:28.336840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:28.337611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:28.338056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:28.338474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:28.412302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:28.420010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fda58b14-4210-4355-8a44-f78bd90c500c tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.096026 Sep 05 14:54:28.420639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1122/2381] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:28 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:54:29.442970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:29.443575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:29.450017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:29.450491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:29.450954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:29.451633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:29.452082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:29.452498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:29.516129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:29.523691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ed9f236-5e4d-4e43-a570-d83e09ef53a4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084641 Sep 05 14:54:29.524248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1260/2382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:29 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:30.546004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:30.546617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:30.548938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=28 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:30.553604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:30.554084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:30.554523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:30.555235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:30.555694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:30.556117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:30.617808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:30.626162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c43376ca-5324-49f9-9fd2-dfa9992488a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084626 Sep 05 14:54:30.627706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1123/2383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:30 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:31.648597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:31.649203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:31.651535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=28 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:31.656225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:31.656697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:31.657121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:31.657796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:31.658242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:31.658659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:31.661195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=84 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:31.722733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:31.730314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f8755c6-df02-49ff-b109-f580ceeea7e9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085621 Sep 05 14:54:31.730892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1261/2384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:31 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:32.752895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:32.753518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:32.759986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:32.760461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:32.760890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:32.761565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:32.762045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:32.762461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:32.822274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:32.830362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-69468111-9082-4466-8f6a-bbb9a87e5fd2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081325 Sep 05 14:54:32.830954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1124/2385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:32 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:33.852528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:33.853166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:33.860140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:33.860877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:33.861310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:33.861979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:33.862425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:33.862863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:33.925326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:33.932862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b8aa929a-7fa6-4d58-8239-fd56a4ea7ee6 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084197 Sep 05 14:54:33.933416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1262/2386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:33 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:34.955234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:34.955787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:34.962217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:34.962696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:34.963160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:34.963839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:34.964289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:34.964712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:35.028182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:35.036409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-81421915-06a0-44f9-9e69-acedff5ca5d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085201 Sep 05 14:54:35.036962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1125/2387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:34 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:36.058909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:36.059519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:36.066489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:36.067005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:36.067435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:36.068111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:36.068555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:36.068975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:36.130612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:36.138155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8d6fe0df-e1e0-4911-b535-f24a67fd0b60 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083152 Sep 05 14:54:36.138714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1263/2388] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:36 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:37.160484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:37.161091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:37.167447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:37.167959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:37.168393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:37.169070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:37.169519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:37.169939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:37.230072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:37.240520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-65d47407-2602-4958-8fdb-ed7f448b725a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081764 Sep 05 14:54:37.240520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1126/2389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:37 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:38.261575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:38.262189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:38.268604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:38.276148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:38.276148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:38.276148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:38.276148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:38.276670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:38.334732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:38.342537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-422303ef-70ac-479c-be3d-f06f68d428f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084885 Sep 05 14:54:38.343633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1264/2390] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:38 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:39.365931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:39.366470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:39.372865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:39.373349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:39.373785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:39.374469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:39.375456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:39.375882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:39.435297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:39.443567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e08d10ba-0aad-4eb4-b8d1-d0492e1e9d37 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081760 Sep 05 14:54:39.444129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1127/2391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:39 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:40.466899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:40.467516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:40.474553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:40.475067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:40.475507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:40.476184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:40.476634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:40.477056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:40.537192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:40.544775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3e9da45-7919-46d9-9ea0-21b2245ca42b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081815 Sep 05 14:54:40.545691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1265/2392] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:40 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:41.566404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:41.567032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:41.573383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:41.573856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:41.574282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:41.574984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:41.575430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:41.575842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:41.635718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:41.643402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ee3a9eb4-b310-4d3f-b330-21a57ae0e6a3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080844 Sep 05 14:54:41.643961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1128/2393] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:41 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:42.666111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:42.666803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:42.673852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:42.674365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:42.674836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:42.675525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:42.675980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:42.676402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:42.740024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:42.747702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c89e1a30-7e1c-4435-b0fa-9ebf964705f9 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085434 Sep 05 14:54:42.748257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1266/2394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:42 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:43.771148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:43.771757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:43.777792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:43.778271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:43.778745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:43.779448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:43.779899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:43.780351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:43.839846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:43.847450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a808f9f4-d73e-40d4-8a2f-8c7c373e474a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080247 Sep 05 14:54:43.848013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1129/2395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:43 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:44.870048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:44.870660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:44.877733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:44.878228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:44.878645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:44.879355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:44.879809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:44.880228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:44.939812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:44.947388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-edb65bb5-bf39-416f-9f1f-81098ae3a5d0 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081267 Sep 05 14:54:44.947952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1267/2396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:44 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:45.969163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:45.969763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:45.976309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:45.976793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:45.977231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:45.977914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:45.978373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:45.978813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:46.038888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:46.046433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-918d989f-7469-49ba-a20a-9ca68b751222 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081218 Sep 05 14:54:46.047039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1130/2397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:45 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:47.069517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:47.070136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:47.076200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:47.076689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:47.077138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:47.077831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:47.078338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:47.078774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:47.143452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:47.151152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-024963b8-2ae2-47e3-b1c6-46c08fe7a09e tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085685 Sep 05 14:54:47.151715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1268/2398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:47 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:48.173594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:48.174217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:48.180947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:48.181425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:48.181860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:48.182547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:48.183048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:48.183469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:48.243894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:48.251969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c957b8d6-1cc2-45d0-ab5e-f872c3665bab tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082231 Sep 05 14:54:48.252525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1131/2399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:48 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:49.274142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:49.274674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:49.280989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:49.281463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:49.282522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:49.283222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:49.283670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:49.284086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:49.342889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:49.351141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-27251475-30da-4776-8fe6-a7014f053dd3 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080837 Sep 05 14:54:49.351934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1269/2400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:49 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:50.373594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:50.374124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:50.380558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:50.381040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:50.381474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:50.382158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:50.382610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:50.383064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:50.444903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:50.452539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-73ff876d-2a91-4b26-991c-5b29277e602b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082937 Sep 05 14:54:50.453102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1132/2401] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:50 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:51.474536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:51.475182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:51.482001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:51.482479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:51.482956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:51.483639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:51.484119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:51.485071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:51.547938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:51.555506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-feb87f1d-a3f4-4d22-b11a-77e569b4e4c2 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084841 Sep 05 14:54:51.556385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1270/2402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:51 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:52.578873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:52.579484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:52.585784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:52.586256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:52.586727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:52.591871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:52.591871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:52.591871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:52.791927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:52.800155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-645ff885-bad2-43b4-8016-528216d9c0f7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.225219 Sep 05 14:54:52.800724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1133/2403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:52 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:53.822540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:53.823184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:53.829611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:53.830096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:53.830513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:53.831225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:53.831677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:53.832096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:53.892735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:53.900429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c77863e5-65a6-434e-9e6f-83c33595fbda tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081798 Sep 05 14:54:53.900984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1271/2404] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:53 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:54.922732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:54.923378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:54.929732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:54.930213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:54.930642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:54.931421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:54.931872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:54.932293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:54.934779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=84 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:54:54.993366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:55.001599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-87176efb-1de8-4eb5-9516-dfdb1c94505d tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082240 Sep 05 14:54:55.002146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1134/2405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:54 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:56.024077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:56.024681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:56.031111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:56.031586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:56.032014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:56.032685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:56.033132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:56.033544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:56.096339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:56.103666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e423878b-bc6c-4346-a6da-77f9ae0e99d8 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083528 Sep 05 14:54:56.104228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1272/2406] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:56 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:57.127340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:57.127945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:57.134361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:57.134872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:57.135300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:57.135973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:57.136413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:57.136827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:57.196569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:57.204005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4950dfa0-76e3-4d94-8b75-399d6817b17b tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081066 Sep 05 14:54:57.205113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1135/2407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:57 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:58.227506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:58.228118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:58.230426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:54:58.230565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:54:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 (ip 10.222.0.15) !!! Sep 05 14:54:58.237401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:58.237881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:58.238312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:58.239022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:58.239475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:58.239895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:58.301413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:58.309156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-445683a1-5f70-4cf1-b824-87a8e3ec992a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.085551 Sep 05 14:54:58.309720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1273/2408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:58 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:59.332547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:59.333162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:59.339825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:59.340354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:59.340792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:59.341485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:59.341934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:59.342361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:59.404314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:54:59.411988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-138e817c-6745-4132-a2d8-5396f919dd48 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084166 Sep 05 14:54:59.412546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1136/2409] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:54:59 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:54:59.797193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:59.797703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:59.804877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:59.805362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:59.805793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:59.806507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:59.807004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:59.807426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:59.835498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:54:59.913121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:54:59.918615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:54:59.919828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:59.920310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:59.920746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:59.921437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:54:59.921887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:54:59.922314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:54:59.948251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:55:00.109811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-63e2890c-f6ea-4a17-b3e2-946d42d28807 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 204 len: 0 microversion: 2.20 time: 0.316272 Sep 05 14:55:00.110464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1274/2410] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 5 14:54:59 2022] DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 14:55:00.120107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:00.120812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:00.126818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:00.127311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:00.127747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:00.128459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:00.128953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:00.129397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:00.247286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e0c81a6b-0aaf-4b51-8d0f-f585d20c4045 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 204 len: 0 microversion: 2.1 time: 0.337893 Sep 05 14:55:00.248450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1137/2411] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:54:59 2022] DELETE /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 14:55:00.263940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:00.264729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:00.265317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:00.270918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:00.271494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:00.272004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:00.272844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:00.273371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:00.273903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:00.274333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:00.275820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:00.277014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-36bdf8e0-1174-4bc8-b5a8-46582e2bab8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1801 microversion: 2.20 time: 0.161050 Sep 05 14:55:00.277564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1275/2412] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1801 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:00.406272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:00.415061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b47aa047-112f-47e8-9f30-665252d8286f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.155404 Sep 05 14:55:00.415622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1138/2413] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:00.433528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:00.434134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:00.440093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:00.440567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:00.441078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:00.441755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:00.442199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:00.442614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:00.446560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:00.503153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:00.511198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-620b4c48-aaee-405d-be84-79248928a98a tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081614 Sep 05 14:55:00.514740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1276/2414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:00 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:01.305061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:01.305791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:01.307765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:01.312370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:01.312848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:01.317523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:01.317523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:01.317523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:01.317523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:01.437922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:01.438678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:01.445815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:01.446290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:01.446717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:01.447457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:01.447905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:01.448321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:01.586132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:01.594822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:01.596184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:01.597777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a66c7d40-a654-4b73-b26f-a115aaceccf3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1801 microversion: 2.20 time: 0.296681 Sep 05 14:55:01.610879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1139/2415] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1801 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:01.610879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:01.610879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:01.610879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:01.610879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:01.611730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:01.611730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:01.611730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:01.612144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:01.691433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:01.699406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-43f08b11-ad86-48eb-a2a7-8141f3b90102 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.099774 Sep 05 14:55:01.699978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1140/2416] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:01 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:01.726404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:01.734737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-46744433-0761-4cac-ab98-18b335e04b6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.301170 Sep 05 14:55:01.735417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1277/2417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:02.533001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-7dc9593a-823b-42c3-ae89-7ad074e26a20 req-9591274a-daa5-45e3-b41e-d0f4b526fa1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f82e417-b9d8-47c8-b4da-32b0c5d2b166", "name": "network-vif-deleted", "tag": "933194a6-fb28-49a9-9652-6e4ff34d194b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:55:02.542447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-7dc9593a-823b-42c3-ae89-7ad074e26a20 req-9591274a-daa5-45e3-b41e-d0f4b526fa1b service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.546538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-7dc9593a-823b-42c3-ae89-7ad074e26a20 req-9591274a-daa5-45e3-b41e-d0f4b526fa1b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.546538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-7dc9593a-823b-42c3-ae89-7ad074e26a20 req-9591274a-daa5-45e3-b41e-d0f4b526fa1b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.554916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-7dc9593a-823b-42c3-ae89-7ad074e26a20 req-9591274a-daa5-45e3-b41e-d0f4b526fa1b service nova] Creating event network-vif-deleted:933194a6-fb28-49a9-9652-6e4ff34d194b for instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 on hv-cinder-84290 Sep 05 14:55:02.559834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-7dc9593a-823b-42c3-ae89-7ad074e26a20 req-9591274a-daa5-45e3-b41e-d0f4b526fa1b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090806 Sep 05 14:55:02.560413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1141/2418] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:55:02.625862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:02.626478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:02.629489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=39,nova_api:UPDATE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:02.634204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.634691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.635162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.635849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.636301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.636719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.702055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:02.710954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:02.712387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:02.713695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0a7f7e6f-3b60-473c-8a19-ef90f551ea0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1733 microversion: 2.20 time: 0.091992 Sep 05 14:55:02.714255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1278/2419] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1733 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:02.722195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:02.722996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:02.729473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.729955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.730584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.731317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.731967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.732395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.759691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:02.760505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:02.767090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.767853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.768289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.770199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:02.770659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:02.771287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:02.799194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:02.807226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f9f09898-0c85-475e-9f01-d6b0cce10d30 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.089193 Sep 05 14:55:02.807917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1142/2420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:02 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:02.901168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:02.909388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ab1d8075-d60b-40de-af6f-3973b3e2335a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.153623 Sep 05 14:55:02.910525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1279/2421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:03.741406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:03.741968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:03.748497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:03.748978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:03.749437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:03.750108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:03.750559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:03.751003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:03.811490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:03.819799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:03.821229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:03.822351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8ab80fd6-ed79-4529-959e-e0b3529ff5b6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085825 Sep 05 14:55:03.822942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1143/2422] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:03.829277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:03.829887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:03.836207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:03.836691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:03.837127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:03.837807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:03.838265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:03.838688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:03.898764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:03.906280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9188b605-c746-4e89-a382-fb948d1e48e4 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.080848 Sep 05 14:55:03.906866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1280/2423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:03 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:03.932852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:03.933485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:03.939374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:03.939849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:03.940283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:03.940960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:03.941410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:03.941850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:04.069396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:04.077708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-46e5ad54-d9b6-4488-a75f-47c4391cefc1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148619 Sep 05 14:55:04.079494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1144/2424] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:04.847307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:04.847916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:04.854210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:04.854689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:04.855161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:04.855842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:04.856296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:04.856718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:04.919458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:04.928771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:04.929468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:04.930075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:04.930196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:04.931328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e2e7985-1885-4667-9219-0ff568d1d85b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087956 Sep 05 14:55:04.931890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1281/2425] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:04.936405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:04.936877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:04.937305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:04.937977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:04.938420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:04.938855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:05.001038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:05.009597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b0625fc2-3ca0-4c17-abc5-7505c357b9c7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.084416 Sep 05 14:55:05.010162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1145/2426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:04 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:05.100299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:05.111442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:05.111442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:05.111442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:05.111442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:05.111883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:05.111883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:05.111883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:05.241370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:05.249574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cc55e502-ec92-4ad4-b51c-ef184117cf10 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.153128 Sep 05 14:55:05.250308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1282/2427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:05.957682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:05.958290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:05.964707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:05.965175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:05.965612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:05.966289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:05.966736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:05.967180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:06.029467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:06.032596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:06.033221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:06.038115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:06.039586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:06.039740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:06.040083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:06.040522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:06.040726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8fedfbef-937c-4ce0-b899-4912b4371364 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087452 Sep 05 14:55:06.041449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:06.041592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1146/2428] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:06.041726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:06.042221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:06.102836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:06.110519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f3282c98-e085-4e35-825a-2ed2c5e78448 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081801 Sep 05 14:55:06.111118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1283/2429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:06 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:06.273049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:06.273661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:06.279624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:06.280106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:06.280544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:06.281228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:06.281689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:06.282115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:06.412581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:06.420817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b298c3e7-3cd9-4a74-acc8-4068185606ec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152238 Sep 05 14:55:06.421377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1147/2430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:07.065458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:07.066061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:07.072876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:07.073354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:07.073789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:07.074462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:07.074936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:07.075356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:07.134131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:07.135129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:07.137325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:07.141245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:07.141724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:07.142157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:07.142862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:07.143326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:07.143738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:07.145840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:07.147308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:07.148447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d395a031-f729-4381-99cf-3358445b3299 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086913 Sep 05 14:55:07.149003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1284/2431] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:07.204427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:07.212116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-20e29a88-1e52-48e9-a9dc-046371c5cdc7 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.081887 Sep 05 14:55:07.212675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1148/2432] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:07 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:07.444444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:07.444974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:07.450876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:07.451357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:07.451791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:07.452471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:07.452954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:07.453376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:07.581188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:07.589279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-427cede1-641e-4af8-adf0-d31baec14b85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149370 Sep 05 14:55:07.589834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1285/2433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:08.173270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:08.173879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:08.180331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:08.180810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:08.181243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:08.181953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:08.182408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:08.182854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:08.235008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:08.235624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:08.243174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:08.243405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:08.243660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:08.244090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:08.244775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:08.245224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:08.245642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:08.245754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:08.252600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:08.254568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:08.255747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3e09b6d-e69f-4e67-b81e-3dfc10f4dbe4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086403 Sep 05 14:55:08.256298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1149/2434] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:08.307519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:08.315157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8fe71aca-4779-4e85-8487-7b3bc12aedeb tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083989 Sep 05 14:55:08.315721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1286/2435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:08 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:08.614335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:08.615012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:08.621635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:08.622111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:08.622545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:08.623261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:08.623721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:08.624145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:08.753643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:08.762502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb926c01-9d55-4b24-9dc4-ad72778a1bac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.153183 Sep 05 14:55:08.763092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1150/2436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:09.288249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:09.288901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:09.295126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:09.295599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:09.296031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:09.296704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:09.297149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:09.297566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:09.337352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:09.337956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:09.344632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:09.345121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:09.345555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:09.346249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:09.346700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:09.347159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:09.359542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:09.368761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:09.370195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:09.371360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-64e6eacb-a26f-463c-8210-47e4c65e6d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087727 Sep 05 14:55:09.371910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1287/2437] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:09.411928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:09.419773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f6a350d4-e8c7-4f14-8799-91de509ba039 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.086207 Sep 05 14:55:09.420338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1151/2438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:09 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:09.785324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:09.785924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:09.791830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:09.792305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:09.792734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:09.793401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:09.793846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:09.794262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:09.923214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:09.931842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e6968c9f-4358-42fe-813b-96409c50647c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150377 Sep 05 14:55:09.932403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1288/2439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:10.396311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:10.396900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:10.403270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:10.403744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:10.404169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:10.404843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:10.405289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:10.405708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:10.441915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:10.442603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:10.449120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:10.449598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:10.450029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:10.450710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:10.451188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:10.451606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:10.470291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:10.479427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:10.480853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:10.481981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3d8a43e0-8a21-4d90-8580-c631e6ebccbe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090147 Sep 05 14:55:10.482530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1152/2440] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:10.513076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:10.520794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fe81be63-28ef-4e91-b32d-02562e40cf95 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.082668 Sep 05 14:55:10.521835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1289/2441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:10 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:10.954517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:10.955182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:10.961083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:10.961563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:10.961991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:10.962664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:10.963141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:10.963561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:11.089599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:11.097844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f6b62887-4fe6-4977-a3d4-233ca1c5fe23 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147119 Sep 05 14:55:11.098399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1153/2442] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:11.507501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:11.508143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:11.514603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:11.515149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:11.515584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:11.516269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:11.516722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:11.517149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:11.543391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:11.543991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:11.550387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:11.551547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:11.551978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:11.552660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:11.553104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:11.553528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:11.582098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:11.590854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:11.592429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:11.593584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c327e315-aeb0-41d2-b3d6-7c1310c25beb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090032 Sep 05 14:55:11.594151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1290/2443] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:11.615031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:11.622654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-def0a32b-e8bf-4ba5-a8a7-9cceca132020 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.083065 Sep 05 14:55:11.623234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1154/2444] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:11 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:12.121466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:12.122078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:12.128080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:12.128562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:12.129487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:12.130164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:12.130615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:12.131065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:12.255533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:12.264006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aaab3cd5-df5a-4f96-b155-e132b09369b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146364 Sep 05 14:55:12.264608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1291/2445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:12.620364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:12.621030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:12.627476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:12.627959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:12.628393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:12.629730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:12.630184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:12.630614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:12.644465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:12.645075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] [instance: 0921c73a-ed22-41a2-b38f-78c587836bb0] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:12.651294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:12.651755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:12.652244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:12.652926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:12.653375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:12.653795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:12.694489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:12.703494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:12.704916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:12.706062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2585397a-5f8b-416e-a2c4-569534c12b13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089763 Sep 05 14:55:12.706620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1155/2446] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:12.723757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '60b48954cad94ade83e974fa28063b7d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '172738e7ad624a429835832020a92723', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:12.726121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:12.732465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-970012ba-a338-498b-922d-aa3bae0335e1 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0" status: 200 len: 1213 microversion: 2.1 time: 0.091887 Sep 05 14:55:12.733036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1292/2447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:12 2022] GET /compute/v2.1/servers/0921c73a-ed22-41a2-b38f-78c587836bb0 => generated 1213 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:12.948123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18dea65f-5ce9-4996-b0f9-cb4f574fc5b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] Calling method '.version_select at 0x7fb194d59f70>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:13.047948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18dea65f-5ce9-4996-b0f9-cb4f574fc5b5 tempest-TestShelveInstance-99308200 tempest-TestShelveInstance-99308200-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2017107774" status: 202 len: 0 microversion: 2.1 time: 0.103725 Sep 05 14:55:13.048524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1156/2448] 10.222.0.15 () {58 vars in 1254 bytes} [Mon Sep 5 14:55:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2017107774 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 14:55:13.287283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:13.287920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:13.294560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:13.295147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:13.295518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:13.296216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:13.296673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:13.297160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:13.431475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:13.455274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-17ea43f0-ece7-47e1-9ad8-78f20f0a1aa3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171764 Sep 05 14:55:13.455860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1293/2449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:13.732217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:13.732826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:13.739731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:13.740484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:13.740678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:13.741363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:13.741813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:13.742233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:13.802748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:13.811452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:13.812895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:13.814041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-46c04d3e-67ad-4bd8-aacd-a6563be9e0d7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086295 Sep 05 14:55:13.814600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1157/2450] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:14.478712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:14.480489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:14.487614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:14.488101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:14.489080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:14.489964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:14.491430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:14.492061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:14.628601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:14.636947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2c1dc24c-0261-446d-9544-ec2ddeea15aa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.162110 Sep 05 14:55:14.637523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1294/2451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:14.841138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:14.841952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:14.849700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:14.850151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:14.850590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:14.851331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:14.851784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:14.852410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:14.916909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:14.926429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:14.927982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:14.929170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-31402dea-b82a-4b1c-8908-9006e63129fb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092152 Sep 05 14:55:14.929736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1158/2452] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:15.660613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:15.661695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:15.668099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:15.668583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:15.669026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:15.669715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:15.670165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:15.670584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:15.823361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:15.837893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c0edfc05-3a6f-4af1-957a-21b2f27d93d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.181173 Sep 05 14:55:15.850890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1295/2453] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:15.953783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:15.954322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:15.961597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:15.962236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:15.962767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:15.963609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:15.964308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:15.964825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:16.034241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:16.044080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:16.045433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:16.046556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-84d582e3-de45-49b5-b7bb-2011667820e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.096810 Sep 05 14:55:16.047255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1159/2454] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:16.862732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:16.864403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:16.869863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:16.870357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:16.870810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:16.871524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:16.871981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:16.872405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:17.015081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:17.024492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ccdd0432-e932-4f3e-b878-5c104e73ca59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.166079 Sep 05 14:55:17.033068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1296/2455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:17.076437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:17.077015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:17.086171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:17.086678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:17.087152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:17.087871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:17.088333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:17.089027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:17.163938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:17.172870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:17.174338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:17.175533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e1473a0b-a734-406e-ba9d-ea874378b63c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.106004 Sep 05 14:55:17.176638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1160/2456] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:18.048875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:18.050188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:18.057498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:18.057983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:18.058911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:18.059605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:18.060055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:18.060671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:18.201471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:18.202679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:18.206376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:18.211329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:18.211815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:18.212278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:18.213270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:18.213846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:18.214514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:18.216076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aa855286-27be-4cf8-9ccf-a3dd08382bab tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171872 Sep 05 14:55:18.216696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1297/2457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:18.277807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:18.286932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:18.288370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:18.289523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ff16dc11-16f3-49cc-8c8b-05313074c4cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091941 Sep 05 14:55:18.290182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1161/2458] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:19.239605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:19.240202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:19.246581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:19.247090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:19.247520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:19.248206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:19.248652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:19.249071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:19.315054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:19.315869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:19.322737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:19.323250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:19.323686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:19.324411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:19.324861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:19.325282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:19.397140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:19.405917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:19.407619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:19.408764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d835af04-8095-45e1-b3de-c995d475f87b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.097795 Sep 05 14:55:19.409330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1162/2459] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:19.413399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:19.421949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-97840639-322c-47e8-9421-5be2e564388a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.186553 Sep 05 14:55:19.422821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1298/2460] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:20.434004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:20.434559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:20.441861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:20.442350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:20.442817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:20.443581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:20.444040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:20.444468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:20.445888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:20.446546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:20.452980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:20.453466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:20.453907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:20.454601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:20.455087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:20.456694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:20.516490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:20.528807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:20.530506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:20.531888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b354fad7-f267-4a99-a458-e4823d3d9886 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.101963 Sep 05 14:55:20.532447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1163/2461] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:20.612154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:20.621109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-669e546e-2d21-44ec-925b-3b8af8f74f64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.179662 Sep 05 14:55:20.621715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1299/2462] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:21.557108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:21.557717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:21.564194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:21.564760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:21.565199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:21.565878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:21.566327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:21.566747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:21.632934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:21.639910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:21.641347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:21.642498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5f79e9fa-419f-462e-9e7a-5aac2c6ec6eb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089269 Sep 05 14:55:21.643101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1164/2463] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:21.645040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:21.645657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:21.653133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:21.653811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:21.655809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:21.655809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:21.655809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:21.655809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:21.787395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:21.796037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a94fa36c-11e8-4be4-a7ee-c0e5dfd93106 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.155383 Sep 05 14:55:21.796587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1300/2464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:22.668678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:22.669281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:22.675683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:22.676155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:22.676581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:22.677255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:22.677697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:22.678112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:22.738550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:22.747069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:22.748514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:22.749622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-99c32e6f-90f9-47e2-8aba-040ef4d66dd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084837 Sep 05 14:55:22.750169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1165/2465] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:22.819408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:22.819960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:22.826385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:22.826901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:22.827344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:22.828035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:22.828494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:22.828920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:22.957134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:22.965302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1c40207-59fd-49bf-bf2a-bb1b17685f26 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150349 Sep 05 14:55:22.965910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1301/2466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:23.774860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:23.775381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:23.781697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:23.782169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:23.782595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:23.783301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:23.783747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:23.784161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:23.846101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:23.854473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:23.855930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:23.857046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7c5091e-8881-4bc5-8794-df59858485de tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086190 Sep 05 14:55:23.857592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1166/2467] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:23.988863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:23.989467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:23.995813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:23.996290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:23.996721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:23.997426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:23.997875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:23.998292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:24.123957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:24.132167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-be9db476-7be0-4ab7-9f16-dbce6a840d09 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148021 Sep 05 14:55:24.132739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1302/2468] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:24.883129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:24.883764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:24.890136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:24.890608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:24.891078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:24.891750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:24.892194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:24.892612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:24.907747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:24.955368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:24.964707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:24.966130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:24.967286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80b16321-ae0c-46ad-af1c-184a9cdf0c58 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088674 Sep 05 14:55:24.967837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1167/2469] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:25.154920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:25.155525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:25.161940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:25.162413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:25.162866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:25.163548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:25.163998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:25.164415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:25.291910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:25.300260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9cb38463-7bf5-4663-908b-11adb80d02a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149186 Sep 05 14:55:25.301338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1303/2470] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:25.992505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:25.993104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:25.999531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:26.000009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:26.000444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:26.001129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:26.001582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:26.002004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:26.063093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:26.071778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:26.073221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:26.074392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b2d889e2-6d3a-401c-9407-02147c943c67 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085811 Sep 05 14:55:26.074987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1168/2471] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:26.323497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:26.324048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:26.330418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:26.330936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:26.331376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:26.332652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:26.333110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:26.333536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:26.461728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:26.469893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ba9fc1e8-a880-4be4-a956-70bec2e0530c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150349 Sep 05 14:55:26.470454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1304/2472] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:27.099961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:27.100569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:27.107034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:27.107517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:27.107951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:27.108628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:27.109082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:27.109505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:27.169809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:27.178307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:27.179770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:27.180906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-395cd84a-9702-4cec-b840-d009a74e5855 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084839 Sep 05 14:55:27.181483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1169/2473] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:27.493632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:27.494241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:27.500730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:27.501212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:27.501644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:27.502326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:27.502779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:27.503230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:27.628380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:27.637027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-22bb6373-9cda-419b-947c-3e0c5d15a76f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147200 Sep 05 14:55:27.637589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1305/2474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:28.206354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:28.207054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:28.213537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:28.214044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:28.214480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:28.215221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:28.215674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:28.216095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:28.278694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:28.289512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:28.289512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:28.290052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b44a7e29-41cf-4d52-b7c7-fa3fce35f892 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087583 Sep 05 14:55:28.290613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1170/2475] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:28.659362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:28.659964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:28.666857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:28.667334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:28.667762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:28.668437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:28.668885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:28.669303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:28.797211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:28.806057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-03f59512-0183-497a-9e87-29f4bf14cb7f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150594 Sep 05 14:55:28.806617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1306/2476] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:29.315898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:29.316478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:29.322814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:29.323308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:29.323744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:29.324427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:29.324880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:29.325303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:29.386503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:29.395116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:29.396563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:29.397706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4f7557f8-78f8-4f94-95af-c5467a746465 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085781 Sep 05 14:55:29.398259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1171/2477] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:29.828650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:29.829257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:29.836130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:29.836608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:29.837038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:29.837711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:29.838158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:29.838576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:29.966116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:29.974760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1bfaeff2-8888-4c73-bd36-481143bbddda tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149981 Sep 05 14:55:29.975338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1307/2478] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:30.423222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:30.423862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:30.430661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:30.431199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:30.431747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:30.432555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:30.433009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:30.433593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:30.515960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:30.524531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:30.525971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:30.527136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6543d346-f980-4256-b5ab-519d496a215c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.107992 Sep 05 14:55:30.527686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1172/2479] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:30.997487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:30.998036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:31.004486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:31.004967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:31.005401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:31.006083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:31.006537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:31.006994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:31.145294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:31.153504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ddeee012-97a5-4abe-91c8-cb1632848002 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.159920 Sep 05 14:55:31.154092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1308/2480] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:31.552301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:31.552916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:31.555263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=69,nova_api:DELETE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:31.559945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:31.560427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:31.560863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:31.561550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:31.562030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:31.562454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:31.624233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:31.633128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:31.634576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:31.635748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3fe1db47-0e26-40f4-8b25-6afb8fa00f1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087355 Sep 05 14:55:31.636305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1173/2481] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:32.176899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:32.177507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:32.183919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:32.184395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:32.184826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:32.185508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:32.185960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:32.190583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:32.201509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:32.315925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:32.323985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aa45900d-4a26-447d-80c4-fcf53313d0be tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151567 Sep 05 14:55:32.324554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1309/2482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:32.662168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:32.662802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:32.669554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:32.670030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:32.670459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:32.671166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:32.671615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:32.672061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:32.733547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:32.742403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:32.743961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:32.745092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b31ae70b-a73c-4381-8660-80d73ea6aa13 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087691 Sep 05 14:55:32.745640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1174/2483] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:33.346363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:33.346920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:33.349222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=64 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:33.354045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:33.354562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:33.355032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:33.355754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:33.356237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:33.356663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:33.484262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:33.493152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b89b29ad-ba86-40bd-ab77-91c58c45239b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150676 Sep 05 14:55:33.493713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1310/2484] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:33.768821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:33.769504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:33.775944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:33.776418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:33.776847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:33.777524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:33.777965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:33.778382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:33.838675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:33.847148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:33.849094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:33.850214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c865e9c8-3d9a-47c7-b97f-0ec2b642910e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085307 Sep 05 14:55:33.850766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1175/2485] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:34.516156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:34.516768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:34.523861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:34.524343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:34.536791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:34.536791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:34.536791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:34.536791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:34.655925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:34.664081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a54b9d17-7f39-4a51-8402-db5dab1fcfd1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151714 Sep 05 14:55:34.664652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1311/2486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:34.876130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:34.876670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:34.883663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:34.884140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:34.884573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:34.885253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:34.885701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:34.886123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:34.946146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:34.954660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:34.956122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:34.957291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4e0eea88-0de3-4f5d-a2af-cd7ad25fab9c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085170 Sep 05 14:55:34.957845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1176/2487] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:35.687605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:35.688142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:35.694472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:35.695118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:35.695550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:35.696227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:35.696673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:35.697090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:35.821903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:35.830292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a67c9c46-785b-4d29-8f1b-ee5750b4da12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146724 Sep 05 14:55:35.830872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1312/2488] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:35.982283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:35.982918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:35.989573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:35.990049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:35.990486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:35.991201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:35.991654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:35.992077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:36.051578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:36.059913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:36.061344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:36.062494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d5d083cc-ba68-4d39-a639-1e47f030a7f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084098 Sep 05 14:55:36.063068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1177/2489] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:36.854524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:36.855160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:36.861589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:36.862327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:36.862757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:36.864088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:36.864541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:36.864964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:36.993272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:37.001384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3f84fab6-5d44-44c8-91c7-5e5badb96894 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150815 Sep 05 14:55:37.001969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1313/2490] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:37.087982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:37.088585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:37.095012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:37.095484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:37.095908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:37.096593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:37.097035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:37.097944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:37.161535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:37.169946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:37.171397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:37.172514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7151ecec-ddfb-4a69-9ddd-8c7ff5216b38 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088627 Sep 05 14:55:37.173065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1178/2491] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:38.024578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:38.025171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:38.031623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:38.032105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:38.032541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:38.033219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:38.033672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:38.034093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:38.163846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:38.171945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bb14531b-bccf-4d4d-adf4-0ec7f403d41f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151279 Sep 05 14:55:38.172510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1314/2492] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:38.197295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:38.197905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:38.204333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:38.204818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:38.205256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:38.205942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:38.206396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:38.207380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:38.267887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:38.276949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:38.278305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:38.279462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0a1e6f7d-030d-4955-824a-7aa9d8c8fb49 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086062 Sep 05 14:55:38.280010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1179/2493] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:39.195087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:39.195694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:39.202168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:39.202647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:39.203110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:39.203819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:39.204276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:39.204696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:39.304699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:39.305314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:39.311583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:39.312058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:39.312487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:39.313164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:39.313608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:39.314022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:39.336357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:39.344712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1aad35da-cae3-4800-8b25-b2862c862ef3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.153733 Sep 05 14:55:39.345287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1315/2494] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:39.374988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:39.383483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:39.384909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:39.386034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3ff6cd20-6b33-412b-98e7-24e5e3d5a59d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085846 Sep 05 14:55:39.386584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1180/2495] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:40.368529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:40.369135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:40.375493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:40.375969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:40.376397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:40.377067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:40.377511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:40.377925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:40.411041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:40.411655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:40.418137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:40.418628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:40.419097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:40.419794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:40.420248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:40.420671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:40.499317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:40.508930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:40.510458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:40.511671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2b4d5ec9-9da7-49b0-b4e4-2d8fe92294fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.104471 Sep 05 14:55:40.512234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1181/2496] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:40.528693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:40.537388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7f27bbe-85e1-466c-ad3a-5c7edacb3e74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172682 Sep 05 14:55:40.537942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1316/2497] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:41.536945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:41.537547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:41.543960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:41.544436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:41.544866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:41.545550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:41.546005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:41.546428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:41.560623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:41.561238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:41.568044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:41.568521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:41.568953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:41.569631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:41.570077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:41.570493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:41.609420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:41.619110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:41.620548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:41.621696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fda1bc9b-182a-4075-af1b-ce991f11e675 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088789 Sep 05 14:55:41.622249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1182/2498] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:41.705053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:41.713341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-63635955-f3c5-41e1-8d2b-db02c105a436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.156578 Sep 05 14:55:41.713949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1317/2499] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:42.648085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:42.648748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:42.656228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:42.656732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:42.657239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:42.658090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:42.658742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:42.659476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:42.730111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:42.735401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:42.736026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:42.740538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:42.742230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:42.742813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:42.743302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:42.743659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a727994d-575e-4fa7-a040-1576e98607a5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.100003 Sep 05 14:55:42.743785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:42.744626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:42.744757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1183/2500] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:42.744876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:42.745294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:42.875144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:42.884031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3cced1bd-1cd7-447f-b1d8-41ce08dc88d4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152543 Sep 05 14:55:42.884600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1318/2501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:55:43.770439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:43.771069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:43.777156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:43.777624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:43.778053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:43.778727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:43.779196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:43.779613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:43.782074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:43.843446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:43.852311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:43.853730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:43.854886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-52d89dc5-fe0a-4932-81d2-0f7aa82a1f89 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088904 Sep 05 14:55:43.855444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1184/2502] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:43.907748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:43.908355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:43.915263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:43.915738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:43.916166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:43.916839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:43.917287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:43.917711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:44.043789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:44.051887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b897f51e-1e26-4d20-8243-e9d84396ec74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147971 Sep 05 14:55:44.052450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1319/2503] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:44.881151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:44.881766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:44.888192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:44.888672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:44.889107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:44.889798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:44.890251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:44.890671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:44.952554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:44.961021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:44.962450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:44.963616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9f411223-9cce-42af-80f1-48d6ecd863db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087033 Sep 05 14:55:44.964169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1185/2504] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:45.074667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:45.075305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:45.081711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:45.082186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:45.082615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:45.083335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:45.083787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:45.084205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:45.212723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:45.220746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40bf13f4-be05-4e50-a1de-61fda4770970 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149920 Sep 05 14:55:45.221303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1320/2505] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:45.989157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:45.989750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:45.996179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:45.996657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:45.997087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:45.997764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:45.998218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:45.998639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:46.059010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:46.067972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:46.069404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:46.070540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2098e101-cbb2-4a36-9d09-b03905b7f638 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085549 Sep 05 14:55:46.071132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1186/2506] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:46.244939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:46.245492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:46.251799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:46.252313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:46.252750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:46.253464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:46.254490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:46.255046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:46.380052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:46.388162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d596171a-ddee-47e4-a284-91a3439f53fc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147174 Sep 05 14:55:46.388727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1321/2507] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:47.096499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:47.096906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:47.103634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:47.104108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:47.104557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:47.105213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:47.105657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:47.106072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:47.169503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:47.178016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:47.179488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:47.180614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3065e678-6639-4ddf-b392-8038bfdf099d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088542 Sep 05 14:55:47.181163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1187/2508] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:47.411234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:47.411775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:47.418138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:47.418611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:47.419070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:47.419751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:47.420198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:47.420613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:47.547778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:47.555787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c5955708-d9dd-4af9-9620-3b67dcaad259 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148718 Sep 05 14:55:47.556352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1322/2509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:48.205019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:48.205629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:48.212229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:48.212703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:48.213130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:48.213809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:48.214289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:48.214713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:48.275475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:48.283948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:48.285855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:48.287035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6f0208e1-2d69-40a8-b56c-b93fac8ce5ca tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085959 Sep 05 14:55:48.291212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1188/2510] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:48.579095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:48.579712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:48.586617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:48.587138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:48.587574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:48.588252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:48.588702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:48.589122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:48.714977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:48.723776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd09ac80-b84f-4636-b9de-1120e92ec620 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148632 Sep 05 14:55:48.724337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1323/2511] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:49.312671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:49.313526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:49.319924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:49.320397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:49.320827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:49.321499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:49.321945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:49.322363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:49.382486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:49.390984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:49.392410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:49.393533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-54451032-9e0b-4696-9491-a21d8c7406f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084843 Sep 05 14:55:49.394082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1189/2512] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:49.745909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:49.746543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:49.753051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:49.753529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:49.753963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:49.754650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:49.755138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:49.755564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:49.880128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:49.888229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6a7d2af5-fa0a-4888-bfc9-93fa0c36b9ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146234 Sep 05 14:55:49.888793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1324/2513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:50.419776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:50.420314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:50.427209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:50.427682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:50.428116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:50.428793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:50.429237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:50.429653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:50.492786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:50.501114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:50.502534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:50.503685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-746066f0-80cc-4500-ab4a-18da5f661f8a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087928 Sep 05 14:55:50.504246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1190/2514] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:50.911905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:50.912510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:50.919101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:50.919586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:50.920021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:50.920708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:50.921163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:50.921616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:51.047230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:51.055406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d8fb72cb-85bf-4238-8fe3-9e7a4f0ec352 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147894 Sep 05 14:55:51.055961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1325/2515] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:51.528352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:51.528947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:51.535313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:51.535786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:51.536213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:51.536889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:51.537332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:51.537747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:51.600456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:51.609424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:51.610860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:51.611986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb3721aa-54aa-4c02-b277-e6c9fa8f9247 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087568 Sep 05 14:55:51.612789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1191/2516] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:52.078334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:52.079101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:52.086290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:52.086769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:52.087235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:52.087922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:52.088373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:52.088796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:52.091372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:55:52.217171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:52.225403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee2deb12-9748-4132-9446-8efdc1c3f41d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150780 Sep 05 14:55:52.225979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1326/2517] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:52.637583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:52.638194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:52.645146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:52.645618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:52.646044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:52.646711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:52.647210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:52.647633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:52.706331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:52.715493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:52.716925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:52.718045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c041f78e-1754-4712-99dd-3dd560ec792a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084387 Sep 05 14:55:52.718598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1192/2518] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:53.248237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:53.248847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:53.255866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:53.256344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:53.256775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:53.257460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:53.257914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:53.258333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:53.383880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:53.391938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2faf346b-db44-4095-9184-b71d668bbe4d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147537 Sep 05 14:55:53.392494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1327/2519] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:53.743122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:53.743736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:53.750660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:53.751169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:53.751605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:53.752284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:53.752734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:53.753154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:53.816279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:53.824803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:53.826314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:53.827479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56f3a2f4-9857-49bd-baf8-231668956d17 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088311 Sep 05 14:55:53.828037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1193/2520] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:54.418440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:54.419028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:54.425335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:54.425811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:54.426242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:54.427007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:54.427456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:54.427873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:54.777621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:54.785730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6927d127-6dd4-4545-afe6-001405d88510 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.371338 Sep 05 14:55:54.786275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1328/2521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:54.852658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:54.853262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:54.859638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:54.860111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:54.860537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:54.861208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:54.861649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:54.862063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:54.921933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:54.930378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:54.931733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:54.932853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e78eca49-d9a3-4b2f-916b-dbbe3a22ff8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084136 Sep 05 14:55:54.933402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1194/2522] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:55.808898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:55.809508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:55.815964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:55.816472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:55.816905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:55.817581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:55.818037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:55.818458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:55.950985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:55.958477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:55.959110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:55.959948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eab4715f-c26e-49f0-ad5c-6532e3aae6fb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.154873 Sep 05 14:55:55.960515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1329/2523] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:55.965359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:55.965822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:55.966248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:55.966950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:55.967405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:55.967815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:56.028180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:56.037061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:56.038479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:56.039622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c87ea1d1-4fd5-4697-8dab-940cbf9f2022 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085519 Sep 05 14:55:56.040174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1195/2524] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:56.983705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:56.984302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:56.991690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:56.992190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:56.992607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:56.993325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:56.993802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:56.994230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:57.065109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:57.065712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:57.071729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:57.072208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:57.072636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:57.073386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:57.073875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:57.074303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:57.130684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:57.138811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d98a5db7-15bc-4841-ba39-a202946bfff0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.158973 Sep 05 14:55:57.139383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1330/2525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:57.149627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:57.158054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:57.159515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:57.161169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-00a1803a-3b79-49d0-8882-7a197a622453 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.100781 Sep 05 14:55:57.161713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1196/2526] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:58.358358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:58.360695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:58.365709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:58.366197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:58.366629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:58.367351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:58.367806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:58.368235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:58.369985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:58.370592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:58.376469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:58.376942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:58.377369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:58.378045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:58.379118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:58.379547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:58.519957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:58.526587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:58.528995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:58.530554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:58.531738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f58d4dbd-381a-4b85-a172-59fc92ae6a3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.348792 Sep 05 14:55:58.532301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1197/2527] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:55:58.535785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-10136f27-8c9c-49d5-9130-a60aa2540c99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.378238 Sep 05 14:55:58.536433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1331/2528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:55:59.556905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:59.557509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:59.558491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:55:59.559167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:55:59.563914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:59.564394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:59.564822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:59.565501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:59.565629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:59.566433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:59.566573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:59.566875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:59.567013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:59.567715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:55:59.568175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:55:59.568599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:55:59.658912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:59.667386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:59.668839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:59.669968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-090d8173-8ed3-4bfd-861f-2d45de24935a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.117016 Sep 05 14:55:59.670530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1198/2529] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:55:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:55:59.726230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:55:59.734335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1b3ef3de-4c48-41e8-8553-481441a80185 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.179844 Sep 05 14:55:59.734923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1332/2530] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:55:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:00.696303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:00.696895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:00.703355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:00.703828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:00.704259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:00.704929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:00.705377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:00.705794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:00.757675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:00.758270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:00.764801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:00.765436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:00.765694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:00.766375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:00.766845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:00.767267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:00.767403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:00.775815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:00.777255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:00.778392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-053ffae1-9722-483c-bbfb-f4426cd278c2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086646 Sep 05 14:56:00.778969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1199/2531] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:00.894642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:00.902666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07bce844-b38f-4a22-8948-3ec8a6205537 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148822 Sep 05 14:56:00.903261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1333/2532] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:01.803247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:01.803864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:01.806233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=54 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:01.811829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:01.812320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:01.812760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:01.813446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:01.813902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:01.814328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:01.875773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:01.877898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:01.885591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:01.887061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:01.888201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ed85fe59-b165-4084-b805-784b324545d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088905 Sep 05 14:56:01.888781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1200/2533] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:01.925299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:01.926420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:01.932849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:01.933330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:01.933764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:01.934445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:01.934938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:01.935361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:02.061342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:02.069989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9c8580eb-3511-463b-9670-b38a68bac7e1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148576 Sep 05 14:56:02.070556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1334/2534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:02.913555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:02.914171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:02.921265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:02.921773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:02.922212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:02.922990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:02.923470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:02.923916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:02.984870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:02.993544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:02.995024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:02.996158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-216fc054-c977-44fa-b411-70daedf905b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087145 Sep 05 14:56:02.996713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1201/2535] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:03.092007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:03.092613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:03.099318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:03.099797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:03.100227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:03.100907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:03.101361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:03.101779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:03.234124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:03.242428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d37bce59-28a5-4939-a9df-9923e9726786 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.154317 Sep 05 14:56:03.243023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1335/2536] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:04.021338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:04.022064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:04.028406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:04.028880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:04.029313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:04.029984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:04.030431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:04.030883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:04.093054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:04.102587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:04.104036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:04.105165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bf791f21-1aff-435c-9f03-e67beb5010b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087714 Sep 05 14:56:04.105720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1202/2537] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:04.264686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:04.265324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:04.267654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=52 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:04.272848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:04.273267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:04.273694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:04.274367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:04.274843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:04.275265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:04.404890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:04.413649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1855af8c-773f-4aaf-a60b-126fc3430b6c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152804 Sep 05 14:56:04.414203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1336/2538] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:05.131251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:05.131882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:05.138238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:05.138709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:05.139171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:05.139849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:05.140293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:05.140710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:05.202126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:05.210638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:05.212092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:05.213228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-375981c2-0288-41fc-a24b-67c57a874f45 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086568 Sep 05 14:56:05.213791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1203/2539] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:05.436972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:05.437546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:05.444347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:05.444828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:05.445263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:05.445948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:05.446402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:05.446845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:05.571181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:05.579179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2f26da73-19dc-414c-b9c5-a9d64f4fe6d1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146081 Sep 05 14:56:05.579740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1337/2540] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:06.238703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:06.239890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:06.246280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:06.246759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:06.247227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:06.247980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:06.248431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:06.248854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:06.311397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:06.321218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:06.322811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:06.323953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-61fefea4-0021-4236-8af3-7590d0584e21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089395 Sep 05 14:56:06.324556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1204/2541] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:06.603377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:06.603991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:06.610435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:06.610952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:06.611389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:06.612074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:06.612787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:06.613208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:06.742156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:06.750472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3058253-23e1-41a0-8635-3dc5a8833c25 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151611 Sep 05 14:56:06.751070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1338/2542] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:07.349620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:07.350179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:07.356709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:07.357256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:07.357699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:07.358389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:07.358870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:07.359296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:07.420147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:07.429326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:07.430752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:07.431927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-615ddf9a-825c-40f9-8a66-2e57a3a871ec tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087060 Sep 05 14:56:07.432485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1205/2543] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:07.773989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:07.774595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:07.780954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:07.781427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:07.781854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:07.782527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:07.783009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:07.783428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:07.912095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:07.920192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0b3709b-109b-4f60-9f7d-b4431792d445 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150611 Sep 05 14:56:07.920755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1339/2544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:08.457939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:08.458543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:08.465663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:08.466144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:08.468213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:08.468213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:08.468213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:08.468213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:08.530751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:08.539178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:08.540608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:08.541736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-adf76d7d-c77a-4f92-8de2-ad4c69059900 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087720 Sep 05 14:56:08.542314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1206/2545] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:08.943454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:08.944064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:08.950434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:08.950950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:08.951380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:08.952057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:08.952507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:08.952928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:09.080525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:09.088606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-08f3b2f2-a367-4534-9ea9-cff75c450e6d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149068 Sep 05 14:56:09.089163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1340/2546] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:09.567810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:09.568422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:09.574762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:09.575267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:09.575695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:09.576365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:09.576809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:09.577223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:09.637546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:09.645878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:09.647839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:09.648956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d6536d0d-ca3a-4c6f-ac8d-fec8cbd40a1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085044 Sep 05 14:56:09.649498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1207/2547] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:10.111680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:10.112286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:10.119513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:10.119992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:10.120418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:10.121092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:10.121540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:10.121956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:10.252079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:10.260877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4e6e8d9f-7edc-436f-95f6-342987281ed4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.153009 Sep 05 14:56:10.261473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1341/2548] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:10.674921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:10.675523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:10.682447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:10.682964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:10.683392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:10.684071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:10.684516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:10.684934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:10.745485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:10.753850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:10.755304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:10.756736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a9a8c490-c755-4a86-8bd3-19de18057846 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085873 Sep 05 14:56:10.757299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1208/2549] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:11.284057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:11.284593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:11.290973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:11.291446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:11.291875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:11.292545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:11.292991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:11.293409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:11.422952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:11.425130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:11.431554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b61f7856-7160-4b52-ab96-5d22e1d3376c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151410 Sep 05 14:56:11.437179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1342/2550] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:11.782010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:11.782601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:11.789116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:11.789599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:11.792035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:11.792035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:11.792035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:11.792035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:11.853160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:11.861931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:11.863637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:11.864768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5fd0b7fd-6ebc-4dec-89d6-768102137617 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086747 Sep 05 14:56:11.865349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1209/2551] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:12.459031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:12.459610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:12.466405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:12.466905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:12.467338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:12.468012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:12.468459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:12.468876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:12.594442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:12.603416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-205a5812-8712-4ade-94f9-a06ba945a4ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148684 Sep 05 14:56:12.604023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1343/2552] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:12.890870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:12.891530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:12.898512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:12.899022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:12.899454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:12.900134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:12.900584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:12.901004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:12.960629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:12.968964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:12.970400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:12.971575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-900e78c3-04d3-4e83-af1c-0b6e36a5ba6e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084620 Sep 05 14:56:12.972122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1210/2553] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:13.625951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:13.626626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:13.632892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:13.633402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:13.633835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:13.634509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:13.634984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:13.635403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:13.764022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:13.772150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96083903-7960-4fdd-9dcf-54532d0fa65f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150157 Sep 05 14:56:13.773292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1344/2554] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:13.996626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:13.997269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:14.003376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:14.003856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:14.004288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:14.004969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:14.005420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:14.005841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:14.070776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:14.079625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:14.081067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:14.082264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d32e7436-0ff6-4cb9-a820-79cc5cff1566 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089646 Sep 05 14:56:14.082834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1211/2555] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:14.796668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:14.797287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:14.804239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:14.804716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:14.805150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:14.805828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:14.806280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:14.806702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:14.936317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:14.944391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0377b26f-6eba-41e9-947c-3ac8e30cee8c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151590 Sep 05 14:56:14.944948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1345/2556] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:15.113727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:15.114406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:15.121429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:15.121903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:15.122331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:15.123053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:15.123498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:15.123912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:15.184370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:15.192881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:15.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:15.195458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c2d4b3de-44b8-4249-91ef-fc1e4d3a0b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085937 Sep 05 14:56:15.196006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1212/2557] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:15.967198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:15.967793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:15.974149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:15.974622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:15.975085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:15.975765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:15.976214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:15.976635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:16.102974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:16.111041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6341cca9-3d31-457f-abe6-9fb8fc256b71 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147720 Sep 05 14:56:16.111601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1346/2558] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:16.220467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:16.220993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:16.227121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:16.227593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:16.228021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:16.228688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:16.229132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:16.229550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:16.290465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:16.298871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:16.300297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:16.301450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2584054-e649-4c73-a3b2-6ac87b5ae5a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084926 Sep 05 14:56:16.301999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1213/2559] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:17.135356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:17.135978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:17.142396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:17.142903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:17.143337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:17.144015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:17.144469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:17.144889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:17.273587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:17.282147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c7c33313-1737-40ae-bb9e-02e5c0bceff5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151396 Sep 05 14:56:17.288468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1347/2560] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:17.327513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:17.328227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:17.334581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:17.335173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:17.335593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:17.336351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:17.336812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:17.337253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:17.398706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:17.407316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:17.408848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:17.409979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-27201bb1-44f9-4b96-ac4a-4f2ff4d8c4e2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086376 Sep 05 14:56:17.410533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1214/2561] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:18.306080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:18.306683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:18.313102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:18.313582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:18.314008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:18.314684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:18.315160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:18.315582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:18.435768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:18.436354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:18.442449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:18.443229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:18.443439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:18.444114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:18.445116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:18.445535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:18.445645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:18.453729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-55f29320-a68e-4056-bd2e-fe8cf32b547e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152163 Sep 05 14:56:18.454303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1348/2562] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:18.507675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:18.516351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:18.517787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:18.518946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fbe4ac36-45ea-408e-b79c-070b4f015167 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087143 Sep 05 14:56:18.519506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1215/2563] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:19.476202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:19.476815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:19.483307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:19.493090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:19.493090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:19.493090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:19.493090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:19.493597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:19.544154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:19.544790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:19.551257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:19.551742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:19.552247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:19.552937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:19.553390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:19.553818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:19.619022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:19.627696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:19.629123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:19.630284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-65b4cf32-13b1-411c-9a48-9565f1bc3039 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090045 Sep 05 14:56:19.630928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1216/2564] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:19.640967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:19.649548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7c5cddef-083b-4825-9e4b-e1a2b44f292f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.177195 Sep 05 14:56:19.650106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1349/2565] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:20.656443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:20.657038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:20.663530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:20.664007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:20.664439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:20.665116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:20.665567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:20.665987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:20.671955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:20.672558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:20.679550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:20.680038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:20.680473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:20.681128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:20.682015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:20.682363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:20.682857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:20.735572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:20.745294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:20.746722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:20.747891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-128bd6e7-ef6f-42af-9dd6-ceec805a7126 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095423 Sep 05 14:56:20.748450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1217/2566] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:20.828229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:20.836391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e715d19-b5f3-4127-a8f5-657dec9a56a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.168293 Sep 05 14:56:20.836961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1350/2567] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:21.773567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:21.774277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:21.780622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:21.781097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:21.781524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:21.782204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:21.782649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:21.783090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:21.844375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:21.853248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:21.854665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:21.855838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c7f14bed-cb2f-4ea2-94a7-9a566ce9b125 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086194 Sep 05 14:56:21.856392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1218/2568] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:21.859159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:21.859791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:21.866751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:21.867738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:21.868164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:21.868839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:21.869318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:21.869735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:22.000421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:22.008552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-81bd4cf2-c8c8-4d66-8253-d287db2f994e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.153398 Sep 05 14:56:22.009114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1351/2569] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:22.881608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:22.882156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:22.888459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:22.888930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:22.889358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:22.890028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:22.890475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:22.890920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:22.951372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:22.959662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:22.961569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:22.962685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-14ce9545-33a9-4226-984b-7108773d3ffc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085209 Sep 05 14:56:22.963271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1219/2570] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:23.031829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:23.032441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:23.039180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:23.039830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:23.039830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:23.041061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:23.041549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:23.041969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:23.167072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:23.175213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0d54c1f7-f455-4288-b233-2e9daef4650d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147281 Sep 05 14:56:23.175773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1352/2571] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:23.987958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:23.988554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:23.995581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:23.996057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:23.996485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:23.997160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:23.997604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:23.998023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:24.060831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:24.069172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:24.070582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:24.071789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3eb9b8d9-e981-4dbc-b585-ce8057daa5b9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088044 Sep 05 14:56:24.072342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1220/2572] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:24.199336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:24.199968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:24.206285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:24.206757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:24.207217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:24.207890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:24.208337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:24.208753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:24.333719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:24.342444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d516d6cb-b992-433a-9ae2-3f1f87ac43e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147032 Sep 05 14:56:24.343162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1353/2573] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:25.096806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:25.097441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:25.103929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:25.104399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:25.104827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:25.105499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:25.105942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:25.106355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:25.167067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:25.175947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:25.177367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:25.178489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-35ad6a6e-4dd0-4f81-86ae-f1b354fdfb2f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085643 Sep 05 14:56:25.179083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1221/2574] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:25.366169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:25.366694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:25.373624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:25.374097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:25.374525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:25.375231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:25.375676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:25.376091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:25.503961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:25.512025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b3f0c2e2-e728-4b12-b9a2-a9c9d5f59023 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149975 Sep 05 14:56:25.512588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1354/2575] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:26.203659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:26.204267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:26.210647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:26.211157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:26.211593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:26.212272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:26.212722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:26.213143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:26.273659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:26.282027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:26.283497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:26.284627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5da2c66b-246e-40df-b966-049a6175128b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084972 Sep 05 14:56:26.285187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1222/2576] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:26.534887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:26.535523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:26.542565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:26.543062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:26.543493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:26.544169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:26.544617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:26.545031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:26.671576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:26.679556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e4c4654c-32fb-40bb-a51d-dcefeec924d3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148589 Sep 05 14:56:26.680113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1355/2577] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:27.310942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:27.311481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:27.317876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:27.318353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:27.318812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:27.319490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:27.319939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:27.320361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:27.387576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:27.396034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:27.397464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:27.398628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-caaaaae4-b49f-4049-87a8-7396aff5ec8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091745 Sep 05 14:56:27.399226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1223/2578] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:27.702670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:27.703255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:27.709544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:27.710014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:27.710439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:27.711143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:27.711591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:27.712005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:27.838234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:27.846327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd95417d-549c-45dd-b569-021064c8f841 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147660 Sep 05 14:56:27.846900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1356/2579] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:28.423106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:28.423669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:28.425557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:56:28.425701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:56:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 14:56:28.432116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:28.432620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:28.433054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:28.433737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:28.434186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:28.434607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:28.496545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:28.505087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:28.506521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:28.507693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-13893a22-3f0c-44e7-b941-4fca0ed56b6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088669 Sep 05 14:56:28.508248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1224/2580] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:28.870552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:28.871183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:28.879483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:28.879960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:28.880393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:28.881067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:28.881513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:28.881931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:29.010002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:29.018118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f88512f-e843-428e-a7ed-1b02e124a77a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152316 Sep 05 14:56:29.018676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1357/2581] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:29.533410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:29.533991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:29.540350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:29.540824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:29.541899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:29.542571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:29.543046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:29.543464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:29.602748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:29.611808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:29.613492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:29.614611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f135b5f4-765d-4bff-924d-4ccfbcb48e02 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085105 Sep 05 14:56:29.615202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1225/2582] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:30.039839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:30.040454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:30.046885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:30.047360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:30.047794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:30.048468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:30.048921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:30.049340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:30.174079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:30.182634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-45ac6270-369f-42d7-85f7-ba00339242e4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146119 Sep 05 14:56:30.183227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1358/2583] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:30.639344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:30.639950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:30.646244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:30.646715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:30.647192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:30.647866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:30.648312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:30.648723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:30.711553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:30.719963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:30.721429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:30.722562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cdb61a94-7723-417f-93a8-1db019164382 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087169 Sep 05 14:56:30.723142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1226/2584] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:31.205298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:31.205904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:31.212336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:31.212813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:31.213741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:31.214411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:31.214892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:31.215326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:31.229995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:31.340996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:31.349165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c7e62dd-4202-4f1e-8fed-3f3f9dc7b931 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147679 Sep 05 14:56:31.349727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1359/2585] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:31.749066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:31.749674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:31.756065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:31.756544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:31.756979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:31.757660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:31.758115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:31.758536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:31.821219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:31.830466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:31.831927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:31.833098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-165192c0-bfc5-4b56-82da-6245361f68c3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087963 Sep 05 14:56:31.833644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1227/2586] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:32.373203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:32.373773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:32.380296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:32.384539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:32.384539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:32.384539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:32.384539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:32.384986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:32.588814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:32.597071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b8747fa3-9810-4b5d-bfa5-6cb26012a15c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.228613 Sep 05 14:56:32.597866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1360/2587] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:32.858179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:32.858948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:32.861295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=56 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:32.866249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:32.866875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:32.867375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:32.868273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:32.868732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:32.869179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:32.936811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:32.945546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:32.948394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:32.949732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3e5b1a58-302e-4d31-8abd-1b801cf1ab7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095338 Sep 05 14:56:32.950483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1228/2588] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:33.621453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:33.622051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:33.628550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:33.629033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:33.629467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:33.630148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:33.630600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:33.631045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:33.761207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:33.769263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-52bf4d28-d935-4c0e-b772-c94d02b60a34 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151767 Sep 05 14:56:33.769817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1361/2589] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:33.975309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:33.975944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:33.982260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:33.982734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:33.983214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:33.983867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:33.984312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:33.984728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:34.046959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:34.055310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:34.057215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:34.058330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c5514023-7627-4651-87b7-8fe2275515d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086939 Sep 05 14:56:34.058904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1229/2590] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:34.793397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:34.793955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:34.796249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=52 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:34.800893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:34.801409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:34.801841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:34.802522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:34.803005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:34.806072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:34.929407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:34.937500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9bb7e33a-1e39-4638-966f-2144c5ee9128 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148672 Sep 05 14:56:34.938069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1362/2591] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:35.083598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:35.084203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:35.091231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:35.091705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:35.092134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:35.092812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:35.093255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:35.093672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:35.156553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:35.164952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:35.166382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:35.167580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3bbf93e5-66df-4cb1-994b-3155accbb2fc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087864 Sep 05 14:56:35.168346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1230/2592] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:35.960117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:35.960727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:35.967758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:35.968238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:35.968672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:35.969353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:35.969806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:35.970265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:36.096722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:36.104887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e818ba82-abe7-4076-92f2-924da550d65c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148667 Sep 05 14:56:36.105452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1363/2593] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:36.192385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:36.192987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:36.199909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:36.200378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:36.200805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:36.201487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:36.201932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:36.202345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:36.263322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:36.271817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:36.273240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:36.274360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ba073bff-d22c-4ee2-ae92-17fb59458f97 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085816 Sep 05 14:56:36.274932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1231/2594] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:37.127821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:37.128433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:37.134965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:37.135458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:37.135879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:37.136558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:37.137040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:37.137463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:37.264934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:37.272998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3003b5d-ed91-4437-acab-bbd18731db18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148994 Sep 05 14:56:37.273562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1364/2595] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:37.299408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:37.300011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:37.306694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:37.307207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:37.307662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:37.308353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:37.308801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:37.309222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:37.369950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:37.378419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:37.379893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:37.381039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6b3e41ea-c06d-44be-b8cb-c9e02de1ab5f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085644 Sep 05 14:56:37.381573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1232/2596] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:38.303658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:38.303658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:38.303658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:38.304303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:38.304448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:38.305061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:38.305507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:38.305925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:38.407569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:38.408406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:38.414807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:38.415502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:38.415799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:38.416491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:38.416945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:38.417937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:38.433444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:38.441729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-41785a12-49a0-480a-8467-bc77e0198363 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150199 Sep 05 14:56:38.442297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1365/2597] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:38.482342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:38.491147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:38.492612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:38.493735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9b8f8e14-04cc-4dae-aecf-5f5b301f9c98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090219 Sep 05 14:56:38.494479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1233/2598] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:39.464722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:39.465283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:39.471591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:39.472065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:39.472492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:39.473165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:39.473609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:39.474025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:39.517961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:39.518559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:39.524897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:39.525372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:39.525802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:39.526621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:39.527098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:39.527510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:39.530014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:39.597983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:39.607405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:39.608836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:39.609966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c260daa3-d49e-47c4-b09d-6483b6411974 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095983 Sep 05 14:56:39.610961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1234/2599] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:39.627348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:39.635757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-61ab06a3-2a8d-4489-a46b-7ce1978a999f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.174960 Sep 05 14:56:39.636319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1366/2600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:40.635544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:40.636152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:40.642805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:40.643295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:40.643726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:40.644408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:40.644859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:40.645281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:40.659169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:40.659776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:40.666061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:40.666647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:40.667018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:40.668298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:40.668753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:40.669178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:40.707678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:40.716881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:40.718325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:40.719501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-796cb4d2-c5e0-426a-b3c6-60171a657b19 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087919 Sep 05 14:56:40.720056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1235/2601] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:40.802534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:40.810655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-abcf7d0b-53a2-47a9-b3c3-6d8fbffc23bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.155287 Sep 05 14:56:40.811284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1367/2602] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:41.745142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:41.746222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:41.752632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:41.753108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:41.753538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:41.754217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:41.754669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:41.755123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:41.818391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:41.826958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:41.828404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:41.829536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6d83c030-e151-44cd-9edd-4a3f340702c8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088390 Sep 05 14:56:41.830085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1236/2603] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:41.833595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:41.834200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:41.840671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:41.841145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:41.841572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:41.842310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:41.842757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:41.843199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:41.972504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:41.981056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-30562a33-5e27-4244-9b4a-873ae9c7dd7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151530 Sep 05 14:56:41.981843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1368/2604] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:42.855193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:42.855834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:42.862137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:42.862644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:42.863436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:42.864113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:42.864567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:42.864990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:42.925233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:42.934256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:42.935717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:42.936849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2bb5dcd7-4353-4925-965e-0412010ec117 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085536 Sep 05 14:56:42.937408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1237/2605] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:43.004240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:43.004840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:43.011848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:43.012329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:43.012762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:43.013441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:43.013890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:43.014307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:43.139723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:43.147926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee6793b0-4865-464e-b75b-0222b175854d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147506 Sep 05 14:56:43.148483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1369/2606] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:56:43.962415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:43.963020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:43.968924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:43.969398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:43.969829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:43.970497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:43.970982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:43.971401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:44.031126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:44.039548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:44.040967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:44.042090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7a84ccdf-c176-4626-87ad-925cbf3a1b9e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083719 Sep 05 14:56:44.043189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1238/2607] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:44.172428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:44.173292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:44.180132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:44.180634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:44.181064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:44.181764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:44.182311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:44.182755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:44.315168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:44.323320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3deb592-d997-47d3-9af7-53c7f2c19103 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.155954 Sep 05 14:56:44.323874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1370/2608] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:45.068003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:45.068648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:45.076293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:45.076807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:45.077270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:45.077983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:45.078436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:45.078888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:45.140261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:45.148615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:45.150023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:45.151176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ed5ff807-a6af-42b8-b18d-e469cc01d10a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087089 Sep 05 14:56:45.151726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1239/2609] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:45.346229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:45.346751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:45.353142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:45.353617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:45.354046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:45.354726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:45.355202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:45.355622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:45.484584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:45.492987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8ec1ceb-cde2-4c9b-af08-4292e6db094d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150674 Sep 05 14:56:45.493557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1371/2610] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:46.176376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:46.176990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:46.183403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:46.183885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:46.184325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:46.185008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:46.185463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:46.185891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:46.246650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:46.255154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:46.256605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:46.257743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5fc2b0fc-b4f3-4e8b-998f-6012b56e0c29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085314 Sep 05 14:56:46.258302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1240/2611] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:46.516970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:46.517573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:46.523928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:46.524400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:46.524835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:46.525507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:46.525952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:46.526433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:46.655933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:46.664210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48431a1e-eeb3-4769-a2e5-0f570a2c5165 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151211 Sep 05 14:56:46.664767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1372/2612] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:47.283333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:47.283940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:47.290319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:47.290815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:47.291262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:47.291944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:47.292902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:47.293320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:47.353306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:47.362338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:47.364106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:47.365239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1203c056-35f8-491b-bc69-63500adc0104 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085814 Sep 05 14:56:47.365792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1241/2613] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:47.687246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:47.687821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:47.694120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:47.694589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:47.695070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:47.695743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:47.696217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:47.696635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:47.824902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:47.832957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ac2d415-24e3-41da-9c14-7395065b6512 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149781 Sep 05 14:56:47.833518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1373/2614] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:48.391332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:48.391894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:48.398253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:48.398733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:48.399195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:48.399877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:48.400326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:48.400747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:48.461063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:48.469682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:48.471142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:48.472274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-00fd70e1-62bb-4e3d-91a9-89725aa46537 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084929 Sep 05 14:56:48.472835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1242/2615] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:48.857058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:48.857664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:48.864337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:48.864808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:48.865235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:48.865906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:48.866353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:48.866806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:48.993743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:49.002311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1ed0029-199d-41dc-a1cd-fd8269d58c8d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149582 Sep 05 14:56:49.002885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1374/2616] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:49.498115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:49.498725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:49.505320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:49.505797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:49.506226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:49.506946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:49.507405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:49.507828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:49.570960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:49.579424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:49.580860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:49.581995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b39423b1-d1ad-4bdc-9b95-cc3059978e7d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088405 Sep 05 14:56:49.582545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1243/2617] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:50.025417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:50.026027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:50.033084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:50.033572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:50.034344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:50.034724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:50.035160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:50.035583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:50.164039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:50.172087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a5a02f05-70f5-424e-b4b4-2d4ab839ac2f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150472 Sep 05 14:56:50.172695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1375/2618] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:50.607316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:50.607917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:50.614519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:50.615025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:50.615456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:50.616125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:50.616570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:50.616982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:50.677433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:50.686337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:50.687803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:50.688930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7370a60f-4399-4708-8e86-c0cb72286a9a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085609 Sep 05 14:56:50.689474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1244/2619] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:51.194966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:51.195601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:51.202079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:51.202552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:51.203025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:51.203754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:51.204200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:51.204616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:51.207104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:51.333010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:51.341543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bb8a25c6-d6b5-44de-9187-6da829684d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150514 Sep 05 14:56:51.342108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1376/2620] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:51.714044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:51.715242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:51.721576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:51.722055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:51.722490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:51.723213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:51.723668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:51.724092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:51.785159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:51.793887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:51.795348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:51.796513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f9df6e86-e278-4464-b635-9e73e8800045 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086493 Sep 05 14:56:51.797063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1245/2621] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:52.365400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:52.365945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:52.373074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:52.373547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:52.373981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:52.374650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:52.375135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:52.375553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:52.504131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:52.512240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90d3f469-08ac-4547-a90a-0d44fe573b50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151022 Sep 05 14:56:52.512802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1377/2622] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:52.821549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:52.822156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:52.828580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:52.829055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:52.829513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:52.830193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:52.830643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:52.831097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:52.891507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:52.899844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:52.901280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:52.902984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2f8bdf1c-5fa7-4b87-8159-65b98084a3e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085353 Sep 05 14:56:52.903531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1246/2623] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:53.534404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:53.535044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:53.541437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:53.541911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:53.542342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:53.543045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:53.543499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:53.543921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:53.672500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:53.680622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-845194db-637d-4199-80a8-75f6e891ca29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150094 Sep 05 14:56:53.681188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1378/2624] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:53.928740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:53.929275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:53.936209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:53.936684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:53.937113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:53.937789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:53.938236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:53.938656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:53.998651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:54.006997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:54.008421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:54.009551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f71d0634-0542-4245-a14a-f659c4707bc6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084795 Sep 05 14:56:54.010092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1247/2625] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:54.704680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:54.705405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:54.711895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:54.712372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:54.712805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:54.713490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:54.713947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:54.715092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:54.842652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:54.850740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9572f4a0-fd23-4e99-8088-91e73b22d6dd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150046 Sep 05 14:56:54.851330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1379/2626] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:55.033673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:55.034279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:55.040625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:55.041102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:55.041530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:55.042206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:55.042651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:55.043109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:55.103442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:55.111989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:55.113686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:55.114847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1813821f-46fd-4444-9d34-48f93ba68dd1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085345 Sep 05 14:56:55.115403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1248/2627] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:55.873801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:55.874412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:55.880809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:55.881289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:55.881724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:55.882402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:55.882883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:55.883308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:56.011577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:56.019617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-916614ed-9c27-48d8-baf1-97a429357725 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149750 Sep 05 14:56:56.020183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1380/2628] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:56.141428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:56.141975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:56.148415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:56.148904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:56.149317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:56.149988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:56.150429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:56.150871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:56.213062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:56.222387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:56.223857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:56.224989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-71043552-f245-4e1b-bf82-c0dfc90a8fd6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087528 Sep 05 14:56:56.225542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1249/2629] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:57.043589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:57.044201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:57.050595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:57.051110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:57.051543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:57.052226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:57.052680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:57.053102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:57.179815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:57.187861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0f02df9f-a5cf-494d-8555-92ae12ee603a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148681 Sep 05 14:56:57.188426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1381/2630] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:57.250181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:57.250781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:57.257098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:57.257569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:57.257998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:57.258669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:57.259146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:57.259568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:57.319727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:57.321908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:56:57.328780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:57.332243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:57.332243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-de4467c2-455b-4d6a-8046-326b77b3255b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085047 Sep 05 14:56:57.332243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1250/2631] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:56:58.210813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:58.211426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:58.217770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:58.218248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:58.218684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:58.219389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:58.219871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:58.220292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:58.350640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:58.357163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:58.357768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:58.361083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8601acf6-d031-4bdc-a542-560f3102cf02 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.154174 Sep 05 14:56:58.361789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1382/2632] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:58.365651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:58.366128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:58.366555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:58.367265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:58.367713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:58.368134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:58.429953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:58.439557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:58.441246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:58.442386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-11919a68-7030-434f-a43e-037a22626d3d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089561 Sep 05 14:56:58.442975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1251/2633] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:56:59.384493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:59.385037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:59.391917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:59.392398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:59.392839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:59.393519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:59.393974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:59.394398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:59.467603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:56:59.468324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:56:59.475057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:59.475618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:59.476126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:59.476892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:56:59.477358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:56:59.477789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:56:59.532865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:59.541034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ede12fa-5023-4d21-8dab-77ee4e4f36af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.160556 Sep 05 14:56:59.541607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1383/2634] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:56:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:56:59.549230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:59.558440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:59.559923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:56:59.561059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d405491-cf5e-459f-997b-e6332a2d43d2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.097488 Sep 05 14:56:59.561606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1252/2635] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:56:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:00.564100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:00.564710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:00.571145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:00.571627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:00.572061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:00.572744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:00.573202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:00.574113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:00.586664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:00.587305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:00.594237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:00.594717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:00.595185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:00.595868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:00.596318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:00.596737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:00.669961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:00.678498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:00.679965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:00.682070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2d953d9c-491b-4add-a81e-990cfbea6e1a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.098992 Sep 05 14:57:00.682287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1253/2636] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:00.724236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:00.732464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8ade19cc-ac61-40e8-a341-2b4e698ba506 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172253 Sep 05 14:57:00.733034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1384/2637] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:01.707361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:01.707894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:01.714922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:01.715405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:01.715844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:01.716530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:01.716983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:01.717410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:01.755792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:01.756402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:01.762802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:01.763291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:01.763721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:01.764397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:01.764843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:01.765259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:01.781628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:01.790331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:01.796927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:01.796927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-29e14392-6166-4a47-a2b3-12cd970554e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090213 Sep 05 14:57:01.796927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1254/2638] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:01.892687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:01.900803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf4de8c6-a774-4c7f-bfc6-c2f09e5975bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148806 Sep 05 14:57:01.901365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1385/2639] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:02.818964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:02.819505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:02.825986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:02.826465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:02.826931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:02.827615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:02.828099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:02.828536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:02.892053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:02.900424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:02.901863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:02.903024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2e0ffc22-6b4e-4a35-b57c-290866bc44e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088028 Sep 05 14:57:02.903578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1255/2640] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:02.924048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:02.924691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:02.931095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:02.931590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:02.932003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:02.932715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:02.933826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:02.934249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:03.061525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:03.069751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1fdc53c-9ecf-496a-a8d4-a9d0fe8f70af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149546 Sep 05 14:57:03.070259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1386/2641] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:03.928733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:03.929273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:03.931565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=56 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:03.936710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:03.937183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:03.937675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:03.938353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:03.938826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:03.943685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:04.000390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:04.008793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:04.010221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:04.011943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6af70db4-9d87-424a-b596-c260e2d6d745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086804 Sep 05 14:57:04.012499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1256/2642] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:04.093036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:04.093687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:04.100104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:04.100634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:04.101064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:04.101747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:04.102196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:04.102613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:04.229599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:04.237620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90e65374-1bfd-41cb-9149-3e80474be39b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148547 Sep 05 14:57:04.238223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1387/2643] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:05.036606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:05.037208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:05.043702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:05.044174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:05.044602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:05.045278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:05.045724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:05.046141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:05.110389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:05.119290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:05.120738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:05.121858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bc651797-d15e-4008-b065-fe28f88ef14d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089159 Sep 05 14:57:05.122667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1257/2644] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:05.261693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:05.262305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:05.264676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=52 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:05.269268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:05.269730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:05.270179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:05.270863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:05.271353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:05.271773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:05.400868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:05.409523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f6656525-6443-49bf-acdd-844c76a73551 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152165 Sep 05 14:57:05.410089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1388/2645] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:06.147399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:06.148020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:06.154958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:06.155442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:06.155916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:06.156603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:06.157059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:06.157483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:06.222569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:06.231786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:06.233202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:06.234319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8e9fc274-0425-4e4c-bdfc-25485c5dc1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090886 Sep 05 14:57:06.234891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1258/2646] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:06.431656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:06.432325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:06.438657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:06.439165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:06.442426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:06.442426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:06.442426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:06.442426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:06.570218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:06.579191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-51bedc8a-a8e0-42b0-808b-289544b6f044 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151304 Sep 05 14:57:06.579769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1389/2647] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:07.259790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:07.260402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:07.267437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:07.267920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:07.268356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:07.269038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:07.269494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:07.269921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:07.330154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:07.338809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:07.340270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:07.341406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ff633594-1cf5-4ec0-a9e0-7fd955523e20 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085509 Sep 05 14:57:07.341991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1259/2648] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:07.603029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:07.603583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:07.610540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:07.611052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:07.611492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:07.612176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:07.612632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:07.613060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:07.738212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:07.746588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-195c862b-569f-4e88-a97e-6545f13000c8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147584 Sep 05 14:57:07.747180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1390/2649] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:08.367013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:08.367544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:08.373937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:08.374420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:08.374920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:08.375606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:08.376094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:08.376521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:08.440550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:08.449665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:08.451140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:08.452278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-829c1cb2-ee90-40c9-a7a4-1d993eaafc24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089725 Sep 05 14:57:08.452834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1260/2650] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:08.769382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:08.769988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:08.776568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:08.777056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:08.777486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:08.778163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:08.778612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:08.779054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:09.127035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:09.135073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96b7fe24-8411-4d45-b08b-83d98fee567e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.369514 Sep 05 14:57:09.135642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1391/2651] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:09.477149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:09.477760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:09.484774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:09.485252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:09.485685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:09.486366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:09.486844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:09.487269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:09.550285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:09.559510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:09.560944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:09.562068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9f60f6d2-e04f-4a9e-bae0-1bbdcfd00689 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088809 Sep 05 14:57:09.562628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1261/2652] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:10.157583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:10.158191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:10.164584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:10.165054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:10.165482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:10.166202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:10.166596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:10.167645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:10.292729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:10.294864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:10.301370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3fd537cf-15c8-4c90-b99b-09304d2b5d81 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147835 Sep 05 14:57:10.301925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1392/2653] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:10.586181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:10.586806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:10.593212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:10.593689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:10.594120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:10.594812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:10.595282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:10.595703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:10.656171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:10.664575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:10.666014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:10.667857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-58f305ab-a545-4703-b0a8-c51a54ef9abe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084914 Sep 05 14:57:10.668408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1262/2654] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:11.326715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:11.327283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:11.334099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:11.334572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:11.335028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:11.335707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:11.336157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:11.336577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:11.460863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:11.469012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b4c365a0-6f8b-40dc-91c2-dc2444ffd07e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146779 Sep 05 14:57:11.469582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1393/2655] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:11.693179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:11.693701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:11.700793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:11.701272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:11.701705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:11.702385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:11.702866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:11.703293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:11.766055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:11.774536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:11.775998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:11.777131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-da5a40a5-1e95-47e3-b801-b0be0cf3337f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087953 Sep 05 14:57:11.777688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1263/2656] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:12.491847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:12.492459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:12.498956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:12.499443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:12.499878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:12.500563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:12.501019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:12.501445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:12.627825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:12.636502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7406b8c-815c-4558-a55f-b996e1ef18ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148249 Sep 05 14:57:12.637074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1394/2657] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:12.802569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:12.803152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:12.809576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:12.810041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:12.810465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:12.811162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:12.811609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:12.812025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:12.872132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:12.880640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:12.882110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:12.883272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-91223c91-ba4e-45fd-9b07-c7f09a184b75 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084699 Sep 05 14:57:12.883823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1264/2658] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:13.660176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:13.660911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:13.668013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:13.668520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:13.668949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:13.669659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:13.670109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:13.670546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:13.725590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:13.726211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:13.732900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:13.733616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:13.734171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:13.734964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:13.735481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:13.736110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:13.763114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:57:13.810048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:13.818170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-978269f5-df6f-4ef9-83ce-d316d22a5ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.161826 Sep 05 14:57:13.818735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1395/2659] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:13.885792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:13.908801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:13.909437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:13.915272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:13.917747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:13.917747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:13.917747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:13.918076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:13.918451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:13.977677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:13.986635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:13.988158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:13.989547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-84057b9c-e166-469a-a7f0-0888f685ade5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084818 Sep 05 14:57:13.990106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1396/2660] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:14.080700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9bb322fe-d549-4a99-9aa5-65d3cea6a9e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 204 len: 0 microversion: 2.1 time: 0.358543 Sep 05 14:57:14.081210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1265/2661] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:57:13 2022] DELETE /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 05 14:57:14.090030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:14.090823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:14.096933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:14.097652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:14.098085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:14.098780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:14.099484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:14.100088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:14.227636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:14.236831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-12e2ded9-4936-41d0-ac56-0f3612b7ec33 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.151332 Sep 05 14:57:14.237399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1397/2662] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:14.842195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:14.842913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:14.849247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:14.849719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:14.850149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:14.850857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:14.851305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:14.851721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:14.982938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:14.987450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d0c74f9-d10f-4b80-93fe-9b2a02a2e67c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150060 Sep 05 14:57:14.988009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1266/2663] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:15.015838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:15.016439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:15.022768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:15.023272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:15.023699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:15.024370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:15.024814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:15.025231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:15.093833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:15.103021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:15.104468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:15.106200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8b045ef3-3e5c-4a48-8f0c-bbcfd4da648b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.094194 Sep 05 14:57:15.106735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1398/2664] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:15.259864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:15.260509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:15.266505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:15.267024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:15.267465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:15.268152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:15.268608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:15.269034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:15.393307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:15.401978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0f70ac88-4729-484a-94a1-7b1e239d8210 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.145538 Sep 05 14:57:15.402544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1267/2665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:16.010594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:16.011837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:16.017749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:16.018318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:16.018638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:16.019338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:16.019784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:16.020197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:16.136643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:16.137242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:16.143583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:16.144062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:16.144491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:16.145171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:16.145619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:16.146039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:16.149562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:16.157784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5140f723-f623-45ab-9406-37dd12bebf68 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150973 Sep 05 14:57:16.158353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1399/2666] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:16.208795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:16.217180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:16.218607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:16.219760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7645aec3-fda2-42d5-a1fb-8d9870e9df36 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087590 Sep 05 14:57:16.220304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1268/2667] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:16.427438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:16.428031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:16.434574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:16.435098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:16.435534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:16.436215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:16.436662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:16.437085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:16.561494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:16.569635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7f08d5ec-48b0-4ebb-b262-d90252e4cb49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.146097 Sep 05 14:57:16.570193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1400/2668] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:17.180012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:17.180646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:17.187680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:17.188187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:17.188614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:17.189289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:17.189731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:17.190145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:17.244816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:17.246117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:17.252497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:17.252978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:17.253408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:17.254090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:17.254541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:17.254987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:17.322523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:17.331017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:17.332531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:17.333750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b75757d4-2d87-4adf-8404-ba37ed77b477 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092855 Sep 05 14:57:17.334315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1401/2669] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:17.344539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:17.352677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-231dec6e-6f9c-498a-98b0-784165916366 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.176520 Sep 05 14:57:17.353237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1269/2670] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:17.592629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:17.593163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:17.599049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:17.599529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:17.599959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:17.600639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:17.601092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:17.601511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:17.731097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:17.739427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c8962ba-84ca-4e06-9424-cf60d4c8af2a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.151193 Sep 05 14:57:17.739997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1402/2671] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:18.359588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:18.360121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:18.366455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:18.370209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:18.370209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:18.370209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:18.370209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:18.370704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:18.375703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:18.376455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:18.382885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:18.383367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:18.383795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:18.384465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:18.384910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:18.385352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:18.434811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:18.443916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:18.445354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:18.446504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96f7de9c-8b6f-4f3a-b3a4-5d1148c154e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091663 Sep 05 14:57:18.447130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1270/2672] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:18.528250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:18.536359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1d087309-6c34-421e-ab2d-f4e6220c634e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.164478 Sep 05 14:57:18.536913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1403/2673] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:18.761456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:18.762101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:18.768168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:18.768650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:18.769080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:18.769764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:18.770218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:18.770646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:18.901822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:18.910027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-589b929b-c742-4a55-98bf-0e65f5ee406c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.152497 Sep 05 14:57:18.910593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1271/2674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:19.471451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:19.472065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:19.478463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:19.478987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:19.479919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:19.480603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:19.481052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:19.481471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:19.541104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:19.550025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:19.551496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:19.552637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7559f2d1-62d8-4854-950e-5bfc11602eaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085080 Sep 05 14:57:19.553198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1404/2675] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:19.559499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:19.560189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:19.566711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:19.567293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:19.567826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:19.568586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:19.569117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:19.569618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:19.695111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:19.703505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7235e732-7b5d-4aa4-9b4a-77f451139160 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148504 Sep 05 14:57:19.704091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1272/2676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:19.933135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:19.933662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:19.939586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:19.940063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:19.940492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:19.941168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:19.941614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:19.942031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:20.069106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:20.078004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f8903164-5060-45a7-ba69-8cb43d65c0ab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.148720 Sep 05 14:57:20.078717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1405/2677] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:20.578686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:20.579318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:20.585692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:20.586177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:20.586617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:20.587333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:20.587792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:20.588217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:20.650088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:20.659080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:20.660524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:20.661658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cade2daf-e425-40bb-8775-53a27e1f4e82 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086936 Sep 05 14:57:20.662221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1273/2678] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:20.727285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:20.727896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:20.734840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:20.735316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:20.735743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:20.736415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:20.736859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:20.737275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:20.862104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:20.870357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ae16dd1-2b1d-4023-804d-693f29d9e9c9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146928 Sep 05 14:57:20.870940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1406/2679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:21.101442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:21.102084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:21.108218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:21.108694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:21.109127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:21.109799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:21.110291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:21.110661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:21.239661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:21.248183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1fa64268-f517-4be5-a7d4-318ae15997f0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.150645 Sep 05 14:57:21.248745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1274/2680] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:21.688290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:21.688889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:21.694894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:21.695397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:21.695827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:21.696496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:21.696942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:21.697357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:21.757572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:21.766027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:21.767491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:21.768611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-37b38b90-39e6-4f9c-84c1-41eab11f572a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084209 Sep 05 14:57:21.769157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1407/2681] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:21.893431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:21.894102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:21.900606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:21.902641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:21.902641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:21.902641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:21.903121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:21.903544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:22.029759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:22.038660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-74bac8c1-fd70-45a8-a3b4-3f5be9e4b8a9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148676 Sep 05 14:57:22.039042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1275/2682] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:22.271320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:22.271857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:22.278250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:22.278725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:22.279176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:22.279849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:22.280318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:22.280733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:22.407236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:22.415428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6eb7661-b7cb-4dad-83fa-e88a999a89e6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147955 Sep 05 14:57:22.416003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1408/2683] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:22.793400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:22.794001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:22.799959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:22.800430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:22.800856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:22.801524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:22.801967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:22.802382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:22.862260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:22.871372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:22.872793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:22.873915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4c2ce0dc-e564-43f4-bff0-5336626af371 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084440 Sep 05 14:57:22.874467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1276/2684] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:23.061377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:23.061928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:23.068245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:23.068721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:23.069147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:23.069823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:23.070278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:23.070728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:23.086294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:23.201552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:23.209641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06e60738-c43c-4b0d-8ffb-8e0cf2d671ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152163 Sep 05 14:57:23.210205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1409/2685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:23.439252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:23.439795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:23.446146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:23.446624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:23.447197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:23.447883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:23.448941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:23.449363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:23.575686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:23.583769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a804a852-d583-471f-a172-8487a8313182 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.148495 Sep 05 14:57:23.584323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1277/2686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:23.898386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:23.899024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:23.905098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:23.905579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:23.906011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:23.906694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:23.907173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:23.907598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:23.967979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:23.976485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:23.977928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:23.979085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e2cb2f17-3d40-4540-b878-037c453d865b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084672 Sep 05 14:57:23.980166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1410/2687] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:24.233457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:24.234065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:24.240284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:24.240759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:24.241191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:24.241868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:24.242318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:24.242738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:24.370768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:24.378912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-abc42408-89c5-4786-833b-da4dd5d95377 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149729 Sep 05 14:57:24.379479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1278/2688] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:24.606059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:24.606670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:24.613078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:24.613556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:24.614243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:24.614954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:24.615406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:24.615827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:24.744320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:24.752618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ff2ae011-c983-40ef-9ce7-dca1cbde755f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.150478 Sep 05 14:57:24.753205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1411/2689] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:25.005250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:25.005859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:25.012893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:25.013371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:25.013808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:25.014488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:25.014980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:25.015405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:25.076413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:25.085062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:25.086486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:25.087642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a7d27468-ab65-4595-ab4f-b93b10d0f306 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086389 Sep 05 14:57:25.088188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1279/2690] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:25.401747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:25.402281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:25.408209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:25.408687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:25.409114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:25.409789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:25.410235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:25.410653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:25.538558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:25.547175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e68edc96-d8d1-4c27-8095-816f9866da0a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149319 Sep 05 14:57:25.547741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1412/2691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:25.775866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:25.777001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:25.783000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:25.783479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:25.783915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:25.784599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:25.785052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:25.785476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:25.910858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:25.919480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9978f13b-d10f-47cb-b451-f155213b38f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147497 Sep 05 14:57:25.920054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1280/2692] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:26.112194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:26.112830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:26.119513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:26.120638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:26.121080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:26.121763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:26.122215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:26.122636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:26.183697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:26.192152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:26.193589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:26.194755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7456d8f5-ff11-45b3-af60-276f1a33f249 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086522 Sep 05 14:57:26.195338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1413/2693] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:26.570713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:26.571346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:26.577726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:26.578193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:26.578620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:26.579314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:26.579763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:26.580177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:26.711168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:26.719829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e4cd291f-f7bc-452a-9de6-0c072bf432b6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152922 Sep 05 14:57:26.720379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1281/2694] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:26.942954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:26.943493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:26.949817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:26.950295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:26.950728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:26.951437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:26.951890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:26.952308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:27.080582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:27.089408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-84f1cf2a-ed66-4278-b62e-650a6e2ffb62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.149752 Sep 05 14:57:27.089981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1414/2695] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:27.219902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:27.220515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:27.226524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:27.227041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:27.227482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:27.228169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:27.228626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:27.229054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:27.244589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:27.292715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:27.301030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:27.302459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:27.303624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8a87e479-cdbc-4cfa-bc52-1a779ca56989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087661 Sep 05 14:57:27.304184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1282/2696] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:27.743457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:27.744078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:27.751487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:27.751968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:27.752401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:27.753082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:27.753532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:27.753954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:27.881219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:27.889344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-18cba3d6-9e12-4ea7-afef-6e092672e726 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149702 Sep 05 14:57:27.889908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1415/2697] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:28.113735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:28.114610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:28.121038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:28.121515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:28.121947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:28.122631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:28.123108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:28.123534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:28.248041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:28.256166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae634511-552d-4b6f-9a37-09619c26e377 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.146639 Sep 05 14:57:28.256722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1283/2698] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:28.329137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:28.329734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:28.336224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:28.336706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:28.337139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:28.337822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:28.338270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:28.338746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:28.405193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:28.413792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:28.415268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:28.416442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-92293fc6-0775-45c0-985b-d6f72cd4f366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091339 Sep 05 14:57:28.417497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1416/2699] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:28.912523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:28.913138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:28.919862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:28.920347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:28.920781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:28.921470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:28.921924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:28.922350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:29.051332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:29.059944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4013c0c2-8988-4b11-b0a4-a0b75648a83c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151283 Sep 05 14:57:29.060497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1284/2700] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:29.279461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:29.280063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:29.286398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:29.286906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:29.287340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:29.288010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:29.288453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:29.288865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:29.415735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:29.424513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40864452-0194-470f-a30b-ec652c853f62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.148856 Sep 05 14:57:29.425075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1417/2701] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:29.442079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:29.442805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:29.449079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:29.449556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:29.449992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:29.450668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:29.451153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:29.451573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:29.515351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:29.523770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:29.525204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:29.526860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f699e577-49d1-454b-bacc-b5410fc0153b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088166 Sep 05 14:57:29.527415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1285/2702] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:30.082044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:30.082651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:30.088593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:30.089691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:30.090133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:30.090829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:30.091284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:30.091700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:30.217974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:30.226122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-904fe1a3-94c9-45e7-90d4-67fafcd6fe75 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147927 Sep 05 14:57:30.226679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1418/2703] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:30.447658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:30.448776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:30.455167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:30.455650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:30.456086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:30.456768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:30.457228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:30.457653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:30.552183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:30.552791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:30.559748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:30.560230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:30.560662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:30.561348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:30.561797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:30.562216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:30.584892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:30.593304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f9097ce2-a845-4359-abe9-3213c31d98a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.149610 Sep 05 14:57:30.593877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1286/2704] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:30.626728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:30.635225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:30.636689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:30.637815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fa54d700-c115-40b6-b4cb-ebd8fb999e6f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089520 Sep 05 14:57:30.638362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1419/2705] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:31.248982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:31.249590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:31.255598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:31.256081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:31.256516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:31.257196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:31.257647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:31.258068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:31.386516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:31.394644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-72f6d379-7e0c-4e2b-b7f8-ae84801e7a73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149569 Sep 05 14:57:31.400465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1287/2706] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:31.616909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:31.617434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:31.623790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:31.624258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:31.624683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:31.625349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:31.625793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:31.626205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:31.661636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:31.662240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:31.668913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:31.669399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:31.669831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:31.670524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:31.671010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:31.671436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:31.747067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:31.755690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:31.757127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:31.758310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-21364045-07f3-4761-a2fa-655c26d354cd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.100708 Sep 05 14:57:31.758890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1288/2707] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:31.777158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:31.785414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3af94dac-ceee-4eec-9553-2a9f0e916043 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.172696 Sep 05 14:57:31.785974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1420/2708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:32.418015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:32.418616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:32.424933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:32.425413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:32.425953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:32.426511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:32.426987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:32.427409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:32.640793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:32.649617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8c0a3a54-dc51-422b-9ee7-133397e0ac50 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.236047 Sep 05 14:57:32.650177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1289/2709] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:32.783976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:32.784566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:32.790961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:32.791446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:32.791884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:32.792588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:32.793027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:32.793450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:32.808954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:32.809557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:32.815842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:32.816314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:32.816743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:32.817418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:32.817864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:32.818286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:32.856597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:32.865629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:32.867068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:32.868193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bbe88e1e-aa6d-4dfb-a5fc-43d3e9626f95 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088260 Sep 05 14:57:32.868748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1421/2710] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:32.951446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:32.959562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-300e413b-7797-42d1-9ed5-f3e93889607c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.154435 Sep 05 14:57:32.960121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1290/2711] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:33.674018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:33.674171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:33.680176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:33.680656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:33.681106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:33.681786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:33.682264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:33.683355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:33.809516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:33.817710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d84f7be3-9b03-4b55-8ad5-88e00ab445e0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148107 Sep 05 14:57:33.818278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1422/2712] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:33.893333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:33.893946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:33.900298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:33.900777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:33.901713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:33.902389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:33.902864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:33.903288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:33.968192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:33.976628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:33.978058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:33.979282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b95c00d1-95ae-4fa8-abba-619b43bdf612 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089743 Sep 05 14:57:33.980339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1291/2713] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:33.984167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:33.984786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:33.991005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:33.991486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:33.991923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:33.992608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:33.993098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:33.993530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:34.122234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:34.130409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2d0fa257-e153-4f32-979c-c16888439926 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.150822 Sep 05 14:57:34.131004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1423/2714] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:34.840760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:34.841284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:34.843163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:34.847786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:34.848269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:34.848701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:34.849380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:34.849889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:34.850311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:34.978067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:34.986854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a6f0593-94ec-474b-a95f-d55c7813f923 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150098 Sep 05 14:57:34.987417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1292/2715] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:35.004765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:35.005370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:35.012305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:35.012782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:35.013215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:35.013911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:35.014348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:35.014767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:35.078215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:35.086631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:35.088156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:35.089932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-56a832ec-7943-4993-a1e4-d5e1dec0786a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089007 Sep 05 14:57:35.090489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1424/2716] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:35.154088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:35.154690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:35.160717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:35.161188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:35.161617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:35.162290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:35.162734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:35.163178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:35.290592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:35.297309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b303f515-fb76-4489-82e6-e843f22e4980 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147814 Sep 05 14:57:35.297869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1293/2717] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:36.010091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:36.010758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:36.013059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=74 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:36.017652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:36.018127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:36.018555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:36.019267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:36.019711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:36.020127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:36.115528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:36.116168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:36.123328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:36.123809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:36.124241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:36.124928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:36.125378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:36.125799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:36.147227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:36.155941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40f6115a-c263-4698-ab31-86c1fdbfc80f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149686 Sep 05 14:57:36.156512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1425/2718] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:36.189524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:36.198116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:36.199588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:36.200721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f18f9ee4-1d7d-456f-b40b-daf50b2f08db tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089354 Sep 05 14:57:36.201275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1294/2719] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:36.320604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:36.321134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:36.326990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:36.327477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:36.327914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:36.328599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:36.329048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:36.329466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:36.333414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:36.456690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:36.465353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ff99ce13-12f1-4a80-aad7-72358a86dfce tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.148665 Sep 05 14:57:36.465924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1426/2720] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:37.179650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:37.180256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:37.187254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:37.187731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:37.188163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:37.188835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:37.189278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:37.189695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:37.225309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:37.225913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:37.232339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:37.232817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:37.233247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:37.233968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:37.234414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:37.234854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:37.305722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:37.315110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:37.316560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:37.317711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-47f49c8b-8e81-4b4b-879b-6f688273a1fd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.096201 Sep 05 14:57:37.318301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1427/2721] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:57:37.338095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:37.346245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f2fdc197-b513-4e29-8070-0dcc7ce9fb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170464 Sep 05 14:57:37.346829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1295/2722] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:37.488866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:37.489735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:37.496276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:37.496757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:37.497193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:37.497876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:37.498330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:37.498754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:37.624048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:37.632296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-89cc36de-ceea-41d4-8fe0-f890a7083734 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147332 Sep 05 14:57:37.632860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1428/2723] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:38.342817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:38.343434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:38.353006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:38.353006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:38.353006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:38.353006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:38.353506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:38.353506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:38.370315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:38.371025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:38.377582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:38.378062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:38.378499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:38.379263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:38.379720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:38.380140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:38.415902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:38.425194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:38.426675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:38.427873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1b651789-bbc5-4097-b670-544fdf617cb4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089725 Sep 05 14:57:38.428430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1296/2724] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:38.514167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:38.522287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fef6a99c-d931-473e-8864-a08882c9ffb9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.156482 Sep 05 14:57:38.523008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1429/2725] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:38.655356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:38.655891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:38.661873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:38.662428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:38.662903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:38.663592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:38.664042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:38.664466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:38.789172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:38.797865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-21f9a359-b47a-4a8c-9915-a81ea0bba839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.146485 Sep 05 14:57:38.798408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1297/2726] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:39.453373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:39.453936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:39.460246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:39.460718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:39.461149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:39.461824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:39.462286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:39.462714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:39.525402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:39.534502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:39.536043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:39.537160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0ce248b4-4b2b-443d-8ecf-f26bd9557cb7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087746 Sep 05 14:57:39.537725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1430/2727] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:39.545370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:39.545987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:39.552545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:39.553027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:39.553463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:39.554148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:39.554602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:39.555065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:39.685914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:39.694342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-267760dd-5397-4bba-abb6-f94881e735b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152804 Sep 05 14:57:39.694971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1298/2728] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:39.821378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:39.825306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:39.827946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:39.828424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:39.828853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:39.829531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:39.829977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:39.830399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:39.958753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:39.967611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4a5db77b-2f9e-4c97-9aae-ad699b49130c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.150114 Sep 05 14:57:39.968161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1431/2729] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:40.562339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:40.562969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:40.569341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:40.569821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:40.570250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:40.570960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:40.571407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:40.571824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:40.574809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:40.634539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:40.643422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:40.644838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:40.645956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dfc17b63-486d-4a4f-b69c-53c17c39840a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087542 Sep 05 14:57:40.646547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1299/2730] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:40.717200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:40.717817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:40.724210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:40.724692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:40.725127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:40.725807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:40.726265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:40.726686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:40.855818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:40.863860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-954d774d-9d9e-4849-acfc-148642a07bae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150453 Sep 05 14:57:40.864675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1432/2731] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:40.991836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:40.992452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:40.998750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:40.999255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:40.999686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:41.000361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:41.000804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:41.001219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:41.127325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:41.135594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-911938e3-35c3-4693-83e1-b370ea0cd38e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147834 Sep 05 14:57:41.136190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1300/2732] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:41.672088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:41.672698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:41.678620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:41.679141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:41.679582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:41.680262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:41.680714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:41.681135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:41.741341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:41.749771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:41.751234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:41.752368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6bb3dceb-9943-4636-9e05-930d4cb1ac31 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084204 Sep 05 14:57:41.752924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1433/2733] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:41.887862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:41.888501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:41.894860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:41.895343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:41.895778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:41.896467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:41.896913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:41.897335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:42.025462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:42.034148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-edf19be3-4028-4e24-a22a-7ac4bb35eb32 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150716 Sep 05 14:57:42.034719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1301/2734] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:42.158722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:42.159367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:42.165250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:42.165733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:42.166191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:42.166943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:42.167407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:42.167813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:42.290840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:42.298936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c7443204-66df-4fb2-b05a-a229a1633f79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.144122 Sep 05 14:57:42.299504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1434/2735] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:42.777730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:42.778338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:42.784285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:42.784795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:42.785229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:42.785913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:42.786365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:42.786847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:42.850655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:42.859642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:42.861065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:42.862191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7b5327e-f0e1-4933-8bd9-bebb36a69037 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088416 Sep 05 14:57:42.862731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1302/2736] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:43.055867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:43.056509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:43.062938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:43.063418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:43.063851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:43.064528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:43.064983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:43.065405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:43.191558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:43.199635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-075d99d7-86d0-42cb-b334-5f4ef3e23738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147600 Sep 05 14:57:43.200193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1435/2737] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:43.322143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:43.322775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:43.329593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:43.330064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:43.330492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:43.331193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:43.331640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:43.332053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:43.456532 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:43.465224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0e29fd8c-89fd-4cfe-8eec-e0fc03975a34 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.146891 Sep 05 14:57:43.465808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1303/2738] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:43.887831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:43.888436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:43.894364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:43.894869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:43.895313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:43.895990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:43.896440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:43.896862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:43.958997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:43.967500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:43.968936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:43.970065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-13082c26-f1e3-46fe-95d0-abc5f03ac60f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086834 Sep 05 14:57:43.970626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1436/2739] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:44.223028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:44.223673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:44.230179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:44.230660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:44.231117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:44.231804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:44.232261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:44.232682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:44.359621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:44.368190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6bcb1920-f66b-4581-bfa2-80e17d6e350d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149231 Sep 05 14:57:44.368765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1304/2740] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:44.488207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:44.488746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:44.495947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:44.496424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:44.496857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:44.497536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:44.497992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:44.498412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:44.626540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:44.634723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-33c3a450-21b5-401d-8c8b-31bca84158f1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.150517 Sep 05 14:57:44.635323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1437/2741] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:44.995898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:44.996563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:45.002352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:45.002850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:45.003285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:45.003958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:45.004402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:45.004814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:45.072280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:45.080990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:45.082416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:45.083569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e52aaef7-d657-4473-a2bd-f38a5aaa7f0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092148 Sep 05 14:57:45.084875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1305/2742] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:45.391797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:45.392336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:45.398265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:45.398746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:45.399210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:45.399889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:45.400340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:45.400762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:45.441997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:57:45.442235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:57:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 (ip 10.222.0.15) !!! Sep 05 14:57:45.527453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:45.535380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0b7a346e-5354-4379-8921-dde89699bdc6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147538 Sep 05 14:57:45.535943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1438/2743] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:45.658380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:45.658936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:45.665295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:45.665768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:45.666199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:45.666928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:45.667378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:45.667813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:45.794106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:45.803318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b883dd13-dcf9-436a-890f-e39b04c00695 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.148730 Sep 05 14:57:45.804039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1306/2744] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:46.108483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:46.109095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:46.115420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:46.115897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:46.116327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:46.117004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:46.117458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:46.117877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:46.183228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:46.191656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:46.193094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:46.194228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d7a5309-bbf4-483b-b1f4-1fb230066e87 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089792 Sep 05 14:57:46.194816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1439/2745] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:46.558009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:46.558616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:46.564615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:46.565091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:46.565525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:46.566202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:46.566648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:46.567112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:46.693399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:46.702149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-08537ef3-296a-4dc3-a9f7-0104831bf46c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148057 Sep 05 14:57:46.702703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1307/2746] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:46.827388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:46.828011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:46.834126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:46.834602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:46.835067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:46.835743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:46.836194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:46.836613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:46.962208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:46.970402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2d75b94d-4af7-4e71-b2d8-01bbddf11270 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147643 Sep 05 14:57:46.973311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1440/2747] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:47.220135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:47.220745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:47.227351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:47.227832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:47.228266 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:47.228947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:47.229905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:47.230324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:47.293802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:47.302288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:47.303736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:47.304865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aed6976f-fdbe-4678-8bd2-04f73e4b3b74 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088720 Sep 05 14:57:47.305414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1308/2748] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:47.727059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:47.727664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:47.734540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:47.735055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:47.735490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:47.736166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:47.736614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:47.737048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:47.863156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:47.872044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9c175f1-e85d-44ee-9587-32d925ae3480 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148904 Sep 05 14:57:47.872602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1441/2749] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:47.993768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:47.994404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:48.001584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:48.002068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:48.002505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:48.003232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:48.003686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:48.004106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:48.130843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:48.139394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c8fedb6-bc40-486a-8ce2-d993ffadb44a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.149487 Sep 05 14:57:48.139958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1309/2750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:48.330268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:48.330843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:48.336724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:48.337202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:48.337634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:48.338308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:48.338852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:48.339272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:48.403601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:48.405762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:48.412964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:48.418114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:48.418114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0e070937-1018-4617-9894-c6b458e845e4 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089256 Sep 05 14:57:48.418114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1442/2751] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:48.895155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:48.895755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:48.902212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:48.902684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:48.903143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:48.903821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:48.904263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:48.904679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:49.029945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:49.038074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0190823a-858a-42f5-bb3a-7fca58b48471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146793 Sep 05 14:57:49.038628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1310/2752] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:49.162996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:49.163542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:49.171039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:49.171523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:49.171965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:49.172650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:49.173102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:49.173522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:49.298205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:49.306310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-008a4d45-4b9f-4ce1-9fde-80b18e2ea19a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147239 Sep 05 14:57:49.306897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1443/2753] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:49.441207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:49.441742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:49.447839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:49.448845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:49.449282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:49.449964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:49.450417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:49.450885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:49.514280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:49.522905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:49.524382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:49.525522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-32660efe-cf2b-499d-9173-0d4a65b26203 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088369 Sep 05 14:57:49.526121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1311/2754] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:50.061993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:50.062597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:50.068647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:50.069492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:50.069943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:50.070882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:50.071332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:50.071746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:50.200601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:50.208641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-60e781eb-4635-41ef-a7e6-5ff7f8bc62c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151040 Sep 05 14:57:50.209208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1444/2755] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:50.329116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:50.329731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:50.336222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:50.336703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:50.337136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:50.337816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:50.338264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:50.338688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:50.464825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:50.472897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-93265478-bfac-4d93-857e-cbced93a73ef tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.147628 Sep 05 14:57:50.473459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1312/2756] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:50.550970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:50.551572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:50.557417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:50.557892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:50.558320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:50.559018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:50.559474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:50.559889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:50.622303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:50.630760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:50.632208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:50.633330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-606a34af-3f48-4e9a-bda5-a72ac2559c04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086363 Sep 05 14:57:50.633882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1445/2757] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:51.231752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:51.232579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:51.238523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:51.239047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:51.239737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:51.240419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:51.240867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:51.241287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:51.367755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:51.376462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ed092edc-219d-4606-b9bb-763c222b7120 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149039 Sep 05 14:57:51.377021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1313/2758] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:51.496834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:51.497435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:51.503840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:51.504315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:51.504773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:51.505456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:51.505900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:51.506315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:51.629640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:51.637678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-737c8865-ffc2-4323-b2da-f3402cdaa9d2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.145150 Sep 05 14:57:51.638231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1446/2759] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:51.657461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:51.658064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:51.664090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:51.664566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:51.664993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:51.665669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:51.666118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:51.666540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:51.732022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:51.741216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:51.742646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:51.743869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55f95df5-1703-463f-bd1d-7f056f17e0a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090357 Sep 05 14:57:51.744427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1314/2760] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:52.400182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:52.400707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:52.406622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:52.407130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:52.407562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:52.408234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:52.408690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:52.409104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:52.660467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:52.661062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:52.668371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:52.668855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:52.671122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:52.671876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:52.674772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:52.675245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:52.812249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:52.820320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9019f84c-2217-47d1-a8e5-975bb7c90efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.424039 Sep 05 14:57:52.820882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1447/2761] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:52.825684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:52.826519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:52.832208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:52.832682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:52.833112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:52.833789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:52.834235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:52.834652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:52.841696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:52.843879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:57:52.850773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b5dc3a63-dfaa-40d6-a544-0dfc09e92355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.194415 Sep 05 14:57:52.851365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1315/2762] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:52.896112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:52.904987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:52.906399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:52.907551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9a3a613b-0553-4f57-871f-38b411b4be7b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085765 Sep 05 14:57:52.908105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1448/2763] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:53.843241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:53.843854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:53.850245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:53.850723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:53.851180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:53.851861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:53.852314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:53.852736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:53.878593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:53.879225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:53.885640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:53.886125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:53.886564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:53.887275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:53.887728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:53.888150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:54.032431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:54.040668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae54d982-cab4-4cb7-9a56-f45bf87cdd05 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.201677 Sep 05 14:57:54.041323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1316/2764] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:54.047861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:54.048572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:54.054247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:54.054829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:54.055343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:54.056104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:54.056665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:54.057162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:54.060096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:54.068406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7ac0c62-9155-4067-9459-011660e0bcbe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.193702 Sep 05 14:57:54.068970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1449/2765] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:54.120528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:54.129121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:54.130553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:54.131721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9b8c9220-0ec8-4896-9acc-0e5ae7b3df0c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088929 Sep 05 14:57:54.132278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1317/2766] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:55.064346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:55.064955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:55.071468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:55.071944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:55.072379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:55.077405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:55.077405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:55.077405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:55.096080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:55.096877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:55.103318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:55.103804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:55.104271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:55.104973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:55.105421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:55.105873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:55.254185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:55.262948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6040dac9-81ea-4b78-97ee-ac566aed1770 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.202426 Sep 05 14:57:55.263595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1450/2767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:55.268178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:55.268887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:55.274471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:55.275058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:55.275560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:55.276337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:55.276850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:55.277335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:55.282233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:55.290477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-154b5448-a12f-4069-8dc9-14c41dc34a09 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.203053 Sep 05 14:57:55.291076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1318/2768] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:55.337575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:55.345919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:55.347386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:55.348506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3b0d1735-9cc3-46d1-945c-9591fd93b4c6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083942 Sep 05 14:57:55.349057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1451/2769] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:56.285914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:56.286521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:56.292876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:56.293344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:56.293769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:56.294445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:56.294919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:56.295337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:56.313760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:56.314362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:56.320730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:56.321205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:56.321632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:56.322312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:56.323269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:56.323688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:56.492091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:56.495793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:56.500923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f48e9499-496a-47d8-b60f-185cabc0ff65 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.218911 Sep 05 14:57:56.501573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1319/2770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:56.503845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-df837926-39a1-4731-a160-decd3e86d17e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.193905 Sep 05 14:57:56.504647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1452/2771] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:56.505964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:56.506556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:56.512796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:56.513272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:56.513698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:56.514373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:56.514838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:56.515261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:56.575744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:56.584080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:56.585512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:56.586634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-edf48a62-a204-44df-aae8-ddac86d0a15a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084162 Sep 05 14:57:56.587217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1320/2772] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:57.524639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:57.525250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:57.527182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:57.527800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:57.532333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:57.532813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:57.533237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:57.533917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:57.534158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:57.534359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:57.534645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:57.534773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:57.535116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:57.535801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:57.536251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:57.536681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:57.723957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:57.731168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:57.732284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1fe452f1-1acf-48e6-aea8-927323b8e01b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209706 Sep 05 14:57:57.732853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1321/2773] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:57.737474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:57.738075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:57.739797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-52068373-13c4-40c5-a6ff-25ccc6f537b8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.219004 Sep 05 14:57:57.740505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1453/2774] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:57.744122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:57.744725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:57.745166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:57.745848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:57.746298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:57.746720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:57.811864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:57.820372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:57.821802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:57.823483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-631f430e-624e-43cf-9a86-b02f30a4e8d3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089170 Sep 05 14:57:57.824038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1322/2775] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:58.755514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:58.756627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:58.762807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:58.763431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:58.763822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:58.764305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:58.764739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:58.765424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:58.766238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:58.766379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:58.769535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:58.771242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:58.771242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:58.771242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:58.771612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:58.771964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:58.954338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:58.958313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:58.962579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c6710536-8262-4ec9-9c64-748d1f900435 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210943 Sep 05 14:57:58.963203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1454/2776] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:57:58.966545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aa476223-e3ed-41c5-af2a-bb0599e7d6b1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.208098 Sep 05 14:57:58.970928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1323/2777] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:57:58.971106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:58.971106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:58.974105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:58.974578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:58.975032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:58.975711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:58.976159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:58.976574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:59.040193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:59.049058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:59.050480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:57:59.051629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-11f64def-9ac2-42f3-a55e-d81bb9a72e03 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087526 Sep 05 14:57:59.052187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1455/2778] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:57:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:57:59.986309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:59.987071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:59.989136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:57:59.989998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:57:59.993702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:59.994176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:59.994607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:59.995947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:59.996397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:59.996816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:59.997025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:59.997539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:59.997975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:57:59.998656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:57:59.999137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:57:59.999556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:00.194905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:00.197677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:00.203353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-949fd379-c035-4522-bf28-d4051d73709b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.218005 Sep 05 14:58:00.204009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1456/2779] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:00.205975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a3008bc-61b6-4332-9d1f-ceb9c1a582e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223669 Sep 05 14:58:00.208507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:00.209105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:00.215211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:00.215690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:00.216122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:00.216798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:00.217248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:00.217667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:00.219118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1324/2780] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:57:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:00.277846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:00.286272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:00.287737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:00.288866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-45d1c69e-a3aa-4794-b24f-8ae1571cdb29 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083953 Sep 05 14:58:00.289418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1457/2781] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:01.226560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:01.227195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:01.228975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:01.229586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:01.233850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:01.234339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:01.234770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:01.235471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:01.235844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:01.235955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:01.236316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:01.236428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:01.236747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:01.237431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:01.237883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:01.238305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:01.429212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:01.433764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:01.438567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4e8ee3d1-edc7-451a-8600-86ddaee31cf9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215812 Sep 05 14:58:01.454341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1325/2782] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:01 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:01.454518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-71a3c931-490a-4450-a74b-711259c1c5dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216867 Sep 05 14:58:01.454518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1458/2783] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:01.454726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:01.454726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:01.454726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:01.454726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:01.455348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:01.455348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:01.455348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:01.455348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:01.516535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:01.525028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:01.526498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:01.527659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-233edd86-ad5c-43a5-9237-794efca34668 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087577 Sep 05 14:58:01.528213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1326/2784] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:02.461732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:02.462299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:02.465002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:02.465615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:02.468939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:02.469427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:02.469861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:02.470546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:02.471029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:02.471454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:02.472202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:02.472680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:02.473108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:02.473816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:02.474264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:02.474681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:02.486119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:02.665845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:02.673689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:02.674009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9c38d86b-2dc4-4a61-8cf7-cdd786d12ca0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216359 Sep 05 14:58:02.674581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1459/2785] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:02.682568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-82f90ca1-469c-4ee7-871c-bcf631d32d7f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.220787 Sep 05 14:58:02.683139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1327/2786] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:02.683452 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:02.684122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:02.690125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:02.690610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:02.691069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:02.691752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:02.692233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:02.692658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:02.755101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:02.764121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:02.765558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:02.766690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5efcbe1e-249c-4c45-ac07-45f79271efaf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087746 Sep 05 14:58:02.767285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1460/2787] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:03.697475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:03.698622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:03.705027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:03.705505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:03.705813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:03.706245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:03.706427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:03.706598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:03.707059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:03.707476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:03.712823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:03.713303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:03.714409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:03.715124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:03.715577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:03.716000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:03.903009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:03.906887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:03.911147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dc859ca4-4b2d-4cd3-85ec-8b11c2d72bcb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217660 Sep 05 14:58:03.911712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1328/2788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:03.915110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4f93cd43-201b-4cb6-9018-1299f0225afa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213114 Sep 05 14:58:03.915668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1461/2789] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:03.916395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:03.917161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:03.922854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:03.923334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:03.923763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:03.924438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:03.924882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:03.925298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:03.986035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:03.995281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:03.996729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:03.997862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4a92ad55-723a-420d-913b-882d10d975e3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084980 Sep 05 14:58:03.998420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1329/2790] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:04.934489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:04.935129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:04.937418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:04.938032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:04.940880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=76 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:04.941798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:04.942319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:04.942749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:04.943466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:04.943914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:04.944332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:04.945623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:04.946109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:04.946550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:04.947334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:04.947786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:04.952091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:05.138040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:05.141224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:05.146336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ef287513-0479-4d83-b224-fbef05bb0e1d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215723 Sep 05 14:58:05.158949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1462/2791] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:05.159127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c001b7ad-1788-4dd8-ad32-46111e0f43f9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215809 Sep 05 14:58:05.159127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1330/2792] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:05.159345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:05.159345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:05.159345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:05.159345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:05.160003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:05.160759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:05.161289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:05.161789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:05.222335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:05.231029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:05.234267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:05.234267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e319e056-116d-4fda-89f2-5f83db5a09f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085603 Sep 05 14:58:05.234267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1463/2793] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:06.171465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:06.172081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:06.173008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:06.173622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:06.175933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=78 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:06.178773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:06.179288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:06.179741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:06.180420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:06.180867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:06.181155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:06.181277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:06.181633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:06.182067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:06.182749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:06.183229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:06.183653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:06.376642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:06.380624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:06.384891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f73af12c-52a8-4fa1-84cd-449accb440c4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217263 Sep 05 14:58:06.385461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1331/2794] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:06.390527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:06.390740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e19bb1f6-1a34-4087-a7cd-65ef72f34c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.221205 Sep 05 14:58:06.391263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:06.392212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1464/2795] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:06.397751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:06.398237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:06.398716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:06.399467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:06.399921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:06.400345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:06.415260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:06.465055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:06.473884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:06.475433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:06.476492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a02da564-c692-40be-8e11-d83aebf91575 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089885 Sep 05 14:58:06.477232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1332/2796] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:07.407851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:07.408441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:07.414921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:07.415334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:07.415794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:07.415907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:07.416004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:07.416992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:07.417444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:07.417869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:07.422877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:07.423364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:07.423835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:07.424529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:07.424988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:07.425448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:07.610539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:07.614871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:07.619065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-82cfb3e9-7c3d-4c67-9cb6-50d25e8fa7a3 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215077 Sep 05 14:58:07.620267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1465/2797] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:07.624708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:07.625320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:07.627684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cfaaec68-cf31-4bbc-8e85-6eede9abd110 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216246 Sep 05 14:58:07.628510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1333/2798] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:07.631057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:07.631541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:07.631977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:07.632658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:07.633365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:07.633857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:07.694129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:07.702624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:07.704093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:07.705233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ff4ea4b-bac3-4176-86b3-bbf976f78e8e tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084044 Sep 05 14:58:07.705791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1466/2799] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:08.642647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:08.643285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:08.650097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:08.650578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:08.650821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:08.651258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:08.651450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:08.651765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:08.652216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:08.652642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:08.657927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:08.658408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:08.658947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:08.659552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:08.660005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:08.660426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:08.843303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:08.847280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:08.851745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-881dad08-c625-42df-b1f0-2cec22eb6b67 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.204810 Sep 05 14:58:08.852322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1467/2800] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:08.855978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2b0fdad6-d9ea-4e77-8feb-392f59129e9f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217171 Sep 05 14:58:08.856668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1334/2801] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:08.857284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:08.857859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:08.863611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:08.864090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:08.864526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:08.865468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:08.865945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:08.866338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:08.926939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:08.936000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:08.937437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:08.938594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e617a37-6dac-410b-a9ef-47bd24257fc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085345 Sep 05 14:58:08.939185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1468/2802] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:09.875453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:09.876069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:09.878951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:09.879775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:09.882445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:09.882960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:09.883394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:09.884071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:09.884516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:09.884931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:09.886576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:09.887101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:09.887544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:09.888228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:09.888682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:09.889105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:10.067594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:10.076562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ce32feb-c8f1-4518-b592-3f83af2934e5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.204855 Sep 05 14:58:10.077321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1335/2803] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:10.081709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:10.082326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:10.083511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:10.088171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:10.088667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:10.089097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:10.089801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:10.090215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:10.090631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:10.092445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-129042e2-622a-4106-b72b-d7f70fc9fe88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217286 Sep 05 14:58:10.094644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1469/2804] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:10.151825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:10.160156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:10.161591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:10.162690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-23a22494-8e0d-416c-b83f-23615888c139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084674 Sep 05 14:58:10.163269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1336/2805] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:11.104014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:11.104617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:11.111276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:11.111779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:11.112320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:11.113034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:11.113478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:11.113892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:11.115547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:11.116297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:11.122657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:11.123176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:11.123610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:11.124301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:11.124752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:11.125173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:11.311463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:11.315554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:11.319588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e23c8125-a0f6-4c69-889d-22c92169a780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219381 Sep 05 14:58:11.320152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1470/2806] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:11.324415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-edb253f5-4cde-4b46-a859-bc7ac72e7aef tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212874 Sep 05 14:58:11.325103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1337/2807] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:11.325253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:11.325818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:11.331531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:11.332011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:11.332437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:11.333111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:11.333558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:11.333976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:11.394711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:11.403750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:11.405226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:11.406291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e2d25378-98b4-4e53-8faa-81ca253a4c4c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085238 Sep 05 14:58:11.406860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1471/2808] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:12.343427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:12.344037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:12.349379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:12.349964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:12.351092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:12.351578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:12.352008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:12.352696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:12.353151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:12.353568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:12.357291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:12.357763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:12.358201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:12.358900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:12.359357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:12.359772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:12.545603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:12.549559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:12.554064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0282b996-31a5-41eb-a8da-42be73fe2701 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214438 Sep 05 14:58:12.554883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1338/2809] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:12.557751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fdb65015-47ef-4388-929f-e19cd09589ea tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212139 Sep 05 14:58:12.558309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1472/2810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:12.559135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:12.559726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:12.568108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:12.569178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:12.569629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:12.570335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:12.570814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:12.571241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:12.632801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:12.641691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:12.643169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:12.645203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c57437e2-ba4f-45b1-93d6-00237868e2dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089587 Sep 05 14:58:12.645807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1339/2811] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:13.577386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:13.577993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:13.580794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:13.581567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:13.584470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:13.584944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:13.585369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:13.586043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:13.586489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:13.586934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:13.587520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:13.587995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:13.588435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:13.589110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:13.589560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:13.589974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:13.777822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:13.781890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:13.786042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-86478e08-ce79-417b-b189-dcaa351cef9f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212713 Sep 05 14:58:13.786621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1473/2812] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:13.790251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3dc27ecb-a4d1-4e66-97b0-471a2a92853d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.213111 Sep 05 14:58:13.791041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1340/2813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:13.791171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:13.792192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:13.797932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:13.798414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:13.798870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:13.799556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:13.800027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:13.800425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:13.860998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:13.869625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:13.871089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:13.872221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8b092698-1a7f-4d47-a714-9d1845c80e08 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084671 Sep 05 14:58:13.872776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1474/2814] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:14.809935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:14.810544 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:14.813826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:14.814441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:14.817013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:14.817502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:14.817937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:14.818631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:14.819117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:14.819545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:14.821273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:14.821758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:14.822196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:14.822901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:14.823356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:14.823778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:15.021681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:15.025886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:15.030248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-52caf4e2-6d2d-44a2-bcca-4f1439db8199 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.224884 Sep 05 14:58:15.030838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1341/2815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:15.034098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ececbb3c-1f7c-4ffa-b27b-b3c3c13dd466 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.224042 Sep 05 14:58:15.034658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1475/2816] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:15.035268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:15.035868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:15.042020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:15.042501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:15.042981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:15.043665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:15.044116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:15.044540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:15.108518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:15.117401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:15.118855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:15.120657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-af90ed37-ec90-4349-b3ac-f9d3d3cb3f41 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088897 Sep 05 14:58:15.121210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1342/2817] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:16.054014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:16.054641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:16.057652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:16.058808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:16.061722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:16.062205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:16.062640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:16.063365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:16.063815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:16.064237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:16.064601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:16.065087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:16.065528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:16.066213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:16.066671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:16.067118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:16.068338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:16.256997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:16.260047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:16.266145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-135c2a3f-8e41-4fea-ae65-8e398538e4f8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216004 Sep 05 14:58:16.266712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1476/2818] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:16.268689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aee261bf-aadd-4ed7-aa47-dcdf6cdee7d7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215360 Sep 05 14:58:16.269249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1343/2819] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:16.274408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:16.275152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:16.280965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:16.281932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:16.282440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:16.283219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:16.283764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:16.284188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:16.498140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:16.506542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:16.508007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:16.509137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-93ed4ad4-e9a8-40f2-8565-3cd32a86c30a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.238477 Sep 05 14:58:16.509700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1477/2820] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:17.288748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:17.289342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:17.290922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:17.291562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:17.295764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:17.296245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:17.296680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:17.297370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:17.297812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:17.297947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:17.298233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:17.298352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:17.298711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:17.299492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:17.299944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:17.300365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:17.491506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:17.494502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:17.500357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ff5efdc4-d3cb-466b-a35d-79f5db457c55 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215684 Sep 05 14:58:17.500932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1344/2821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:17.503358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ccb2f528-afc7-4808-86b0-ca0eeb3a6540 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216196 Sep 05 14:58:17.503909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1478/2822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:17.533227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:17.533836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:17.539725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:17.540209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:17.540648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:17.541334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:17.541815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:17.542242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:17.602890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:17.611512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:17.612957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:17.614089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-84272d1f-6648-4617-8080-3b1b19618d7c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084659 Sep 05 14:58:17.614642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1345/2823] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:18.523872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:18.524489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:18.527331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:18.527767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:58:18.527891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 (ip 10.222.0.15) !!! Sep 05 14:58:18.527998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:18.528811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:58:18.528945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 14:58:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 (ip 10.222.0.15) !!! Sep 05 14:58:18.535636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:18.536117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:18.536552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:18.537285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:18.537738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:18.538160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:18.538270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:18.540144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:18.540591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:18.541284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:18.541774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:18.542195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:18.722006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:18.730346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d1594658-72d9-40d7-9f91-d0b5033e0355 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210394 Sep 05 14:58:18.730777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1479/2824] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:18.732856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:18.735314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:18.735923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:18.741873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:18.742193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0b439b3b-cb96-469e-9d41-048c21d59bf4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.219034 Sep 05 14:58:18.742350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:18.742776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:18.743332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1346/2825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:18.743613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:18.744140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:18.744568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:18.804548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:18.812959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:18.814387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:18.815554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-796fc160-d314-4a56-b26b-a282758e9ee5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083852 Sep 05 14:58:18.816099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1480/2826] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:18 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:19.753490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:19.754035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:19.760396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:19.760871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:19.761299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:19.761984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:19.762428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:19.762870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:19.765380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:19.765992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:19.772468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:19.772948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:19.773382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:19.774070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:19.774523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:19.774984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:19.956196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:19.960189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:19.964971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-785e808b-2e2b-4237-8773-5ea49a1861d7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215385 Sep 05 14:58:19.965545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1347/2827] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:19.968781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-516db300-7dd9-4cec-93a9-8571c599dec1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.207226 Sep 05 14:58:19.970922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1481/2828] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:19.971089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:19.971089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:19.976604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:19.977087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:19.977522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:19.978215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:19.978671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:19.979208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:20.040681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:20.049251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:20.050687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:20.051843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5e9fd054-88f2-4329-bbf1-072b6408ff66 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085389 Sep 05 14:58:20.052401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1348/2829] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:20.988790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:20.989393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:20.993040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:20.993772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:20.996813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:20.997293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:20.997727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:20.998416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:20.998887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:20.999310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:21.001019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:21.002680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:21.002680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:21.002680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:21.003116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:21.003566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:21.007541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:21.192036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:21.195136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:21.200387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-81ba7cf4-b50b-4508-8b4a-ad5a6c6ba66c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.211385 Sep 05 14:58:21.201048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1349/2830] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:21.203289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6092efdf-d7c1-4e7c-8d26-d8437a86b4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218525 Sep 05 14:58:21.204061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1482/2831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:21.205990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:21.206665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:21.212430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:21.212986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:21.214018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:21.214774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:21.215393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:21.215887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:21.280068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:21.288526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:21.289959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:21.291114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fdce1cba-319a-4d28-a480-ae526ca310d0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089057 Sep 05 14:58:21.292315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1350/2832] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:22.223795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:22.224402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:22.225699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:22.226312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:22.231171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:22.231650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:22.232088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:22.232613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:22.232767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:22.233089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:22.233209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:22.233523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:22.233634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:22.234206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:22.234653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:22.235109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:22.423613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:22.426393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:22.431827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f4755989-c174-44e9-9994-27f0c4016f98 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.211856 Sep 05 14:58:22.432984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1483/2833] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:22.435069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c81b88e9-17fb-45a9-ab5f-b1517440d4fa tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213118 Sep 05 14:58:22.435749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1351/2834] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:22.437411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:22.438020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:22.443785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:22.444263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:22.444698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:22.445386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:22.445829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:22.446247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:22.505905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:22.514653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:22.516114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:22.517235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-369ee307-e3be-472d-af0a-cdb04f714f04 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083351 Sep 05 14:58:22.517779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1484/2835] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:23.455270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:23.455884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:23.457048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:23.457662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:23.462328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:23.462835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:23.463271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:23.464189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:23.464451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:23.464671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:23.464897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:23.465104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:23.465310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:23.465785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:23.466238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:23.466659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:23.656900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:23.659896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:23.665385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ce50952-1be9-4a7f-a67f-55e7d7903dd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211937 Sep 05 14:58:23.665949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1485/2836] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:23.668591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0dfe0e2e-991b-468e-9593-d382edc3f42f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217154 Sep 05 14:58:23.674182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1352/2837] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:23.674360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:23.674360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:23.678196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:23.678742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:23.679217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:23.680000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:23.680500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:23.680873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:23.741416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:23.750443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:23.751896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:23.753020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fbcc4305-53f2-46fc-a4f2-e899bd7c8fb3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086167 Sep 05 14:58:23.753565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1486/2838] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:24.689164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:24.689881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:24.691313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:24.691925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:24.696618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:24.697125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:24.697565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:24.698741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:24.699077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:24.699238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:24.699555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:24.699685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:24.699987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:24.700674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:24.701127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:24.701548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:25.112197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:25.115181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:25.121220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f368d251-077f-48ea-91ff-3cb0a27e4269 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.436050 Sep 05 14:58:25.121789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1353/2839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:25.124054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7061b930-3120-45c7-934c-cf58eeb89dfd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.436598 Sep 05 14:58:25.124678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1487/2840] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:24 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:25.126170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:25.126770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:25.132551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:25.133025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:25.133454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:25.134126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:25.134570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:25.135012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:25.194873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:25.203938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:25.205362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:25.206481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2f3408ac-3483-48e3-b105-ee43735ef310 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083802 Sep 05 14:58:25.207074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1354/2841] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:26.144979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:26.145586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:26.147222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:26.147828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:26.152758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:26.153236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:26.153661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:26.154341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:26.154620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:26.154810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:26.155135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:26.155268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:26.155567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:26.156276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:26.156722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:26.157163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:26.344532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:26.347769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:26.352703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ccd9bb5-2853-48cc-8d8e-327f7aceccf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211606 Sep 05 14:58:26.353401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1488/2842] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:26.355913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1dec5c4a-0327-45b1-9e1d-19a57682067a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212640 Sep 05 14:58:26.356624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1355/2843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:26.357783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:26.358364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:26.363951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:26.364419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:26.364861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:26.365794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:26.366240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:26.366655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:26.429206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:26.438064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:26.439534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:26.440773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-62979376-9272-4b5a-9519-807137a77f93 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086538 Sep 05 14:58:26.441321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1489/2844] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:27.376220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:27.376767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:27.379318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:27.379939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:27.383233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:27.383711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:27.384151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:27.384937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:27.385274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:27.385689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:27.386371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:27.386882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:27.387322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:27.388007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:27.388459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:27.388879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:27.570140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:27.576891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:27.578490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-99af7b60-ed65-4430-9349-6c0ad0dcdc01 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.206520 Sep 05 14:58:27.579107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1356/2845] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:27.583636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:27.584227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:27.585429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d32b0cfd-5925-401b-abe2-cebaef5566ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.209845 Sep 05 14:58:27.586167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1490/2846] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:27.594832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:27.595313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:27.595743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:27.596442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:27.596884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:27.597299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:27.660432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:27.669463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:27.670925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:27.672062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-df677a0f-9bee-43dc-86b7-487dad7f92a2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092042 Sep 05 14:58:27.672616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1357/2847] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:28.600830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:28.601439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:28.607877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:28.608358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:28.608642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:28.609048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:28.609263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:28.609466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:28.609913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:28.610335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:28.616018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:28.616508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:28.616938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:28.617674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:28.618119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:28.618535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:28.805208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:28.809011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:28.813879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9fdc0470-c545-4ec9-bb42-5aa4ba326105 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216904 Sep 05 14:58:28.814449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1491/2848] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:28.817444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6fe5946f-7b2a-463d-a80f-f777801d1ce0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212519 Sep 05 14:58:28.818302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1358/2849] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:28.818907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:28.819511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:28.825788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:28.826270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:28.826704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:28.827416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:28.827872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:28.828310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:28.888510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:28.890608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:28.897476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:28.902136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:28.902136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07ee306f-b462-48ea-bd82-1a7075118e0f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084677 Sep 05 14:58:28.902136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1492/2850] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:29.837600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:29.838241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:29.840910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:58:29.841046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:58:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 (ip 10.222.0.15) !!! Sep 05 14:58:29.841151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:29.841665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:29.847575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:29.848053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:29.848486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:29.848847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:29.849301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:29.849420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:29.849750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:29.849866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:29.850168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:29.850435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:29.850916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:29.851337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:30.042852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:30.045952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:30.051037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1805709f-6340-4ec2-ac9d-58a79b06b5fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217357 Sep 05 14:58:30.051687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1359/2851] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:30.054130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f277e6c-8693-4cc5-8389-f32fe367a670 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217385 Sep 05 14:58:30.054857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1493/2852] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:30.056388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:30.056995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:30.062664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:30.063180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:30.063616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:30.064290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:30.064745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:30.065169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:30.126527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:30.135018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:30.137068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:30.138192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4156402f-86a6-4230-acd7-eceb014ac4dc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085594 Sep 05 14:58:30.138748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1360/2853] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:31.073433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:31.074765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:31.076511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:31.077907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:31.081056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:31.081534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:31.081962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:31.082677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:31.083178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:31.083623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:31.083843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:31.084321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:31.084758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:31.085444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:31.085897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:31.086330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:31.274985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:31.279686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:31.284518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9acfde3-24e1-4e4c-8fc6-7cf4301e7dab tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214624 Sep 05 14:58:31.285388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1494/2854] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:31.288875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3769576d-5f9b-40bf-ab61-51e3ba52bd5f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216057 Sep 05 14:58:31.289579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1361/2855] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:31.298981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:31.299728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:31.305765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:31.306248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:31.306685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:31.307436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:31.307886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:31.308316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:31.368903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:31.377393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:31.378834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:31.379961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ba4bcef-685a-4bdc-9e0c-f852003bb926 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085274 Sep 05 14:58:31.380514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1495/2856] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:32.309572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:32.310211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:32.312371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:32.312985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:32.316582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:32.317055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:32.317482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:32.318163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:32.318604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:32.319049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:32.319241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:32.319719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:32.320150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:32.320825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:32.321277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:32.321696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:32.510951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:32.514667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:32.519214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-259aab53-6791-4ce4-ba5b-fd52779947a5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214085 Sep 05 14:58:32.519783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1362/2857] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:32.523122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd4544e2-fca5-4de4-b998-767fffd50662 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.214587 Sep 05 14:58:32.523666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1496/2858] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:32.524207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:32.524804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:32.531046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:32.531522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:32.531952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:32.532671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:32.533123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:32.533546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:32.595894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:32.604994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:32.606431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:32.607596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-318d3d0d-cff4-4785-9443-2dfaf286ae6c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086903 Sep 05 14:58:32.608156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1363/2859] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:33.543518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:33.544224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:33.547198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:33.547877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:33.550931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:33.551414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:33.551842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:33.552525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:33.552975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:33.553391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:33.554143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:33.554613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:33.555072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:33.555748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:33.556192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:33.556608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:33.748993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:33.751934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:33.757341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4da023cb-bdca-47c3-9c69-7865c0c447ff tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218561 Sep 05 14:58:33.757905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1497/2860] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:33.760240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dce152a3-f42b-4c85-bd8c-f19c83e223c2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216806 Sep 05 14:58:33.760924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1364/2861] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:33.762328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:33.762963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:33.768531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:33.769014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:33.769445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:33.770124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:33.770575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:33.771030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:33.830958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:33.839432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:33.840862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:33.841995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-82d5122d-b9a3-4d45-a3c7-a54391eada42 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083185 Sep 05 14:58:33.842541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1498/2862] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:34.780931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:34.781557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:34.781799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:34.783020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:34.787746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:34.788240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:34.788675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:34.789514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:34.789815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:34.790003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:34.790272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:34.790439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:34.790896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:34.791229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:34.791690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:34.792110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:34.984649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:34.991623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:34.993092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66d0a52f-82b7-499f-a40d-e74463e5fb88 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215079 Sep 05 14:58:34.993664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1499/2863] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:34.994043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:34.998931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:34.999540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:35.001588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9e2bff8f-19f4-4727-bd50-c01bbbbdd9a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.225240 Sep 05 14:58:35.003506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1365/2864] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:35.005249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:35.010148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:35.010148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:35.010148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:35.010148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:35.011155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:35.073265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:35.081907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:35.083475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:35.084619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7b360f2-f28f-4de7-8e72-1e820bac078b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089875 Sep 05 14:58:35.085172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1500/2865] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:36.017080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:36.017769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:36.020380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=72 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:36.025071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:36.025546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:36.026615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:36.027328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:36.027793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:36.028239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:36.029203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:36.029812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:36.036114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:36.036538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:36.036968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:36.037656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:36.038101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:36.038521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:36.222688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:36.225580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:36.230986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-238865f8-1277-4dd5-a313-c0d407d02daa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217683 Sep 05 14:58:36.231879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1366/2866] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:36.233872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4db3c90d-86ad-4cb4-8191-0acd96394653 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209084 Sep 05 14:58:36.234418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1501/2867] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:36.236295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:36.236890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:36.242727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:36.243288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:36.243716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:36.244382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:36.245522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:36.246109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:36.306336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:36.316545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:36.318149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:36.319374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-93e087fd-ef17-4d69-bdea-2ad33feb9353 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086518 Sep 05 14:58:36.319945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1367/2868] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:37.254944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:37.255556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:37.257427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:37.258035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:37.261726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=76 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:37.263858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:37.264338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:37.264766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:37.265210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:37.265444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:37.265806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:37.265929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:37.266242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:37.266355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:37.266957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:37.267439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:37.267858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:37.456508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:37.463537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:37.464666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9df4356c-184a-43a6-b98a-1d2388f4c671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.213592 Sep 05 14:58:37.465234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1502/2869] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:37.469668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:37.470266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:37.474155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dffbb45d-402c-4112-89f6-04b5eb11aba9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.220601 Sep 05 14:58:37.481036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1368/2870] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:37.481205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:37.481205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:37.481205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:37.481205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:37.481528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:37.481528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:37.539634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:37.548625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:37.550058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:37.551217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7663c0fb-7355-4e0c-91dd-44f5fb5f75bb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085050 Sep 05 14:58:37.551768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1503/2871] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:38.488547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:38.489144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:38.496337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:38.496818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:38.497253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:38.497841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:38.498281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:38.498391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:38.498507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:38.498811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:38.506041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:38.506517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:38.506987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:38.507671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:38.508121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:38.508538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:38.711698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:38.714874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:38.721393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ab68cc1f-0f48-4e19-8259-7c91d8ebe8a8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.236588 Sep 05 14:58:38.722367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1369/2872] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:38.725591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-76c8481b-91b0-4b08-b151-cb6b8d7890c0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.230783 Sep 05 14:58:38.725591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1504/2873] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:38.729811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:38.730488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:38.736423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:38.736978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:38.737418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:38.738099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:38.738603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:38.739008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:38.800604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:38.809711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:38.811167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:38.812298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0514f816-119e-4186-8a84-a9449e3bff5b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086294 Sep 05 14:58:38.812862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1505/2874] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:38 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:39.744824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:39.745430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:39.752025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:39.752503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:39.752932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:39.753316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:39.753756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:39.753930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:39.754044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:39.754443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:39.759980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:39.760987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:39.761419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:39.762106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:39.762559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:39.763015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:39.944710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:39.948568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:39.953662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-658ec1db-32da-4e54-9f8d-783806125767 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.204171 Sep 05 14:58:39.954231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1506/2875] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:39.956930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bca6a00e-7d77-4249-bf77-0d7efd72756b tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215883 Sep 05 14:58:39.957562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1370/2876] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:39.958765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:39.959393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:39.965138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:39.965616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:39.966051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:39.966732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:39.967211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:39.967633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:40.031365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:40.039833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:40.041269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:40.042408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4a3ee83-bd56-4d6f-bd12-47ac6bb18676 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087236 Sep 05 14:58:40.042990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1507/2877] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:40.976445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:40.977033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:40.979397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:40.980011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:40.983813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:40.986175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:40.986175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:40.986175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:40.986175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:40.986658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:40.987040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:40.987530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:40.987969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:40.988830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:40.989286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:40.989732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:41.179689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:41.189761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb23198c-01ca-4584-91cc-6605b4466bdb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217160 Sep 05 14:58:41.190341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1371/2878] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:41.191474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:41.195039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:41.195638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:41.201375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:41.201725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57154b4c-1192-46f9-a3fd-24ff1b9392b9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.225713 Sep 05 14:58:41.201876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:41.202265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:41.203044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:41.203673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:41.203796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1508/2879] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:41.204100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:41.267432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:41.275914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:41.277370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:41.278508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1be64032-95f8-4a88-8e05-7c001754ce83 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087231 Sep 05 14:58:41.279101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1372/2880] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:42.223460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:42.224069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:42.225210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:42.225827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:42.231196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:42.231674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:42.232104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:42.232783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:42.232906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:42.233228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:42.233349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:42.233646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:42.233759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:42.234376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:42.234850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:42.235275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:42.248404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:42.422714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:42.429408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:42.431020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cffcf0e6-ae86-422c-b717-aa9404b7fc9d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211457 Sep 05 14:58:42.431589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1509/2881] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:42.436957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:42.437562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:42.437938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6cb5b086-6eed-4d84-8b14-b6f69177bfb8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216541 Sep 05 14:58:42.446857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1373/2882] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:42.447044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:42.447044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:42.447044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:42.447044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:42.447404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:42.447404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:42.511571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:42.520054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:42.521474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:42.522599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d69eb074-4d8d-4b14-8c1c-44622545722c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089292 Sep 05 14:58:42.523185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1510/2883] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:43.453459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:43.454002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:43.460446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:43.460758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:43.461218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:43.461342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:43.461447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:43.462003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:43.462448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:43.463069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:43.467640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:43.468117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:43.468541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:43.469215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:43.469661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:43.470080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:43.652553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:43.655673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:43.661111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1387f349-b9f0-4fd2-849d-e3ff4613fe16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211522 Sep 05 14:58:43.661742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1374/2884] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:43.664246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-921abaa8-d8ff-4b36-9468-a10ddd48c240 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.207310 Sep 05 14:58:43.664979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1511/2885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:43.666110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:43.667475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:43.673583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:43.674080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:43.674501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:43.675213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:43.675665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:43.676086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:43.741074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:43.749716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:43.751200 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:43.752335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6eaa3b7a-4e19-46f9-beb9-b0ba4a572cad tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089745 Sep 05 14:58:43.752903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1375/2886] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:43 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:44.686300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:44.687023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:44.688306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:44.688949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:44.693502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:44.693984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:44.694467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:44.695184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:44.695356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:44.695633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:44.695837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:44.696052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:44.696271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:44.696955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:44.697407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:44.698411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:44.888524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:44.891606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:44.896670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1f4de4ea-0039-4f32-950a-f1aa14e54186 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216120 Sep 05 14:58:44.897318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1512/2887] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:44.900104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-52ac52ac-4f16-44ad-b61d-15d20376a43d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216424 Sep 05 14:58:44.909925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1376/2888] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:44.910110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:44.910110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:44.910110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:44.910110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:44.910488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:44.910488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:44.910488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:44.910488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:44.969819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:44.978208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:44.980177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:44.981300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d84f6993-df7a-40b1-8638-42d822f45a4d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083082 Sep 05 14:58:44.981847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1513/2889] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:45.919813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:45.920400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:45.923123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:45.923754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:45.927119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:45.927599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:45.928030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:45.928719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:45.929164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:45.929586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:45.929761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:45.930235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:45.930664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:45.931373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:45.931872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:45.932291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:46.124011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:46.127261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:46.132270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ac5b3f8e-5b2c-422e-bddd-5becf476bc8a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217129 Sep 05 14:58:46.140681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1377/2890] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:46.140874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06dcd83f-ec1b-407c-8cdc-6a38883d5e59 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216109 Sep 05 14:58:46.140874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1514/2891] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:46.141074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:46.141074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:46.143591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:46.144064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:46.144492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:46.145164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:46.145609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:46.146024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:46.209181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:46.218221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:46.219692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:46.220837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4bc46b7-41db-4073-a161-dd351e003356 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087097 Sep 05 14:58:46.221395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1378/2892] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:47.155075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:47.155699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:47.157599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:47.158245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:47.162359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:47.162873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:47.163317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:47.164027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:47.164492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:47.164617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:47.164914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:47.165026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:47.165436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:47.166112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:47.166553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:47.167004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:47.357321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:47.361041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:47.365867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b82c69e-eed2-4bce-b9be-43bfa715a525 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214980 Sep 05 14:58:47.366445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1515/2893] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:47.370051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0840a467-7d35-4f31-9bec-d56ff69c88ac tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215805 Sep 05 14:58:47.371410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:47.372021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:47.377679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:47.378164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:47.378601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:47.379311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:47.379765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:47.380191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:47.382533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1379/2894] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:47.440783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:47.449901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:47.451356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:47.452475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dc807b0a-41a7-46b6-bcc5-6faa79bea042 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085103 Sep 05 14:58:47.453022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1516/2895] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:48.388374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:48.389043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:48.393183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:48.393796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:48.395461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:48.395942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:48.396377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:48.397058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:48.397504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:48.397922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:48.400210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:48.406530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:48.406530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:48.406530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:48.406530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:48.406973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:48.592563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:48.595630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:48.600750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c00eb17f-b183-4184-b83a-d1461eacde0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216241 Sep 05 14:58:48.601613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1380/2896] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:48.603648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3a907b64-4445-4219-bffb-3dbe32dd04bb tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.214301 Sep 05 14:58:48.604204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1517/2897] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:48.606021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:48.606687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:48.612759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:48.613474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:48.613987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:48.614731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:48.615270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:48.616010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:48.676767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:48.685165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:48.686582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:48.687756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3ee59c9c-a9bc-43f6-a487-23c5da1f64f9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085454 Sep 05 14:58:48.688305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1381/2898] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:48 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:49.625271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:49.625835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:49.627439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:49.628060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:49.632349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:49.632831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:49.633264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:49.633951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:49.634400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:49.634520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:49.634841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:49.634968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:49.635391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:49.636109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:49.636567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:49.637658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:49.652193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:49.825634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:49.832021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:49.833876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f1771184-3727-44c9-a8e5-ecb47e5548b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213129 Sep 05 14:58:49.834450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1518/2899] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:49.839026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:49.839632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:49.840366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c5755e9f-88ef-4f4d-b471-29c0fcef2213 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216926 Sep 05 14:58:49.841091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1382/2900] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:49.845486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:49.845973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:49.846409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:49.847202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:49.847664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:49.848092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:49.909878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:49.918220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:49.919669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:49.920788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6c260396-dc08-494d-a91e-799a0e4c336c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085403 Sep 05 14:58:49.921342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1519/2901] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:50.857560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:50.858164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:50.862558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:50.863210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:50.864551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:50.865032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:50.865715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:50.866391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:50.866861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:50.867281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:50.869644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:50.870124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:50.870558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:50.871302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:50.872277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:50.872698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:51.054349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:51.061715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:51.063084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-71ca2ca5-7e43-471b-8f44-d81bfba08311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209860 Sep 05 14:58:51.063655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1383/2902] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:51.068355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:51.068952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:51.070427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bb6843fe-76a9-4934-98f5-ec8a8976017d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.211423 Sep 05 14:58:51.071017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1520/2903] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:51.075236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:51.075932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:51.076639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:51.077495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:51.078098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:51.078701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:51.146897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:51.155859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:51.157269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:51.158382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-54345a9e-fcc7-4e04-a720-3385fbd2ab3b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093660 Sep 05 14:58:51.158954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1384/2904] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:52.086735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:52.087367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:52.092696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:52.093824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:52.093975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:52.094328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:52.094757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:52.095469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:52.095927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:52.096342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:52.100795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:52.101279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:52.101716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:52.102402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:52.102878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:52.103303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:52.277044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:52.285248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c68a1328-df55-492e-875f-4d5890ad6a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.202321 Sep 05 14:58:52.286931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1521/2905] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:52.288139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:52.292168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:52.292836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:52.297595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d21a2f2e-dd5f-483b-a7ee-b58fc60ae53e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.208672 Sep 05 14:58:52.298535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1385/2906] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:52.299730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:52.300215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:52.300649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:52.301338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:52.301790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:52.302245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:52.365203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:52.374488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:52.375934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:52.377068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1cd1a81c-6ad6-433a-b9af-ee516b08cb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088950 Sep 05 14:58:52.377614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1522/2907] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:53.308484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:53.309091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:53.315500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:53.315972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:53.316402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:53.317073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:53.317517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:53.317932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:53.320896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:53.321517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:53.328557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:53.329036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:53.329472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:53.330184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:53.330637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:53.331091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:53.498449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:53.506510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1dfb3d2a-0bd6-4b18-bc0b-a83d0a8f4a20 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.201889 Sep 05 14:58:53.507112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1386/2908] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:53.511483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:53.512628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:53.518155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:53.518636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:53.519097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:53.519780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:53.520226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:53.520645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:53.521542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:53.530114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b01b5c97-af64-44c9-a2a0-c92b02279063 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212961 Sep 05 14:58:53.530685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1523/2909] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:53.585204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:53.593595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:53.595047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:53.596179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8e9f6f53-f3ca-4022-b795-5925718ec006 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088171 Sep 05 14:58:53.596727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1387/2910] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:54.529492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:54.530115 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:54.536653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:54.537141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:54.537577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:54.538262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:54.538713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:54.539183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:54.553043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:54.553660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:54.560583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:54.561068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:54.561503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:54.562185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:54.562643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:54.563090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:54.954212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:54.958268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:54.962369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d3bbb444-e171-40be-a382-f8763b79ad49 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.436803 Sep 05 14:58:54.963032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1524/2911] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:54.967087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-606d7783-263c-41a4-b828-9501b575ea8f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.417837 Sep 05 14:58:54.967781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1388/2912] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:54.968014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:54.968616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:54.974173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:54.974652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:54.975130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:54.975825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:54.976268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:54.976687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:55.036836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:55.045922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:55.047396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:55.048521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-86150590-95f9-4eb3-9795-2a874fc6d2d9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084584 Sep 05 14:58:55.049074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1525/2913] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:55.986387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:55.987080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:55.990772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:55.991422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:55.993707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:55.994179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:55.994608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:55.995307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:55.995755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:55.996169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:55.998382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:55.998887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:55.999322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:56.000002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:56.000455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:56.000878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:56.004798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:58:56.188640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:56.191596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:56.196876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b096464c-d24f-49ea-bc95-bcf693bd8c26 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214876 Sep 05 14:58:56.197443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1389/2914] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:56.199853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-43354405-1ac5-4b45-ade4-1981b7896164 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.213332 Sep 05 14:58:56.200574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1526/2915] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:56.201930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:56.202527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:56.208239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:56.208714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:56.209142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:56.209814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:56.210268 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:56.210678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:56.271820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:56.280979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:56.282403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:56.283606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-48593b4b-ff2f-4667-b64d-28008747aba6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085253 Sep 05 14:58:56.284152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1390/2916] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:57.221853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:57.222573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:57.222951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:57.223560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:57.229084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:57.229566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:57.229883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:57.230019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:57.230362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:57.230670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:57.230911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:57.231151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:57.231576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:57.232339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:57.232617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:57.233023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:57.423402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:57.427224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:57.432014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ae32d9d-9a55-4ef9-885d-6e0adbd35582 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214251 Sep 05 14:58:57.432585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1527/2917] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:57.435898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4561670a-676d-48f3-b740-adc9d1fa30af tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216980 Sep 05 14:58:57.436637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1391/2918] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:57.437039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:57.437704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:57.443738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:57.444213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:57.444641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:57.445521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:57.445952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:57.446551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:57.507877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:57.516713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:57.518182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:57.519403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-77c77d8d-a087-4250-a47f-9fc9ea909a3c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085923 Sep 05 14:58:57.519951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1528/2919] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:58.459792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:58.460345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:58.461100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:58.461719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:58.466753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:58.467270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:58.467713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:58.468067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:58.468376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:58.468541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:58.468825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:58.468960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:58.469244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:58.469635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:58.470084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:58.470504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:58.660104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:58.667403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:58.668282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4499ee05-8fb3-470a-b7b8-234019ec4575 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211017 Sep 05 14:58:58.668858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1529/2920] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:58.673830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:58.674646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:58.676588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fd697901-ee02-47f0-a590-e41d8de3c114 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.220751 Sep 05 14:58:58.677208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1392/2921] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:58.683977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:58.684462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:58.684888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:58.685575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:58.686058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:58.686475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:58.747584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:58.756249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:58.757681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:58.758835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-345fd601-8641-4b6a-aa52-630b0c6e13be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088521 Sep 05 14:58:58.759395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1530/2922] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:58:59.691325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:59.691936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:59.698388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:59.698890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:59.699198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:59.699612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:59.699812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:59.699980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:59.700926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:59.701345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:59.706721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:59.707224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:59.707658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:59.708344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:59.708797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:59.709226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:59.890939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:59.897661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:59.899089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d719bde7-7096-49bc-bc0a-e561ae5b93bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211559 Sep 05 14:58:59.899659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1393/2923] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:58:59.904647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:58:59.905240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:58:59.906538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f0009bbd-d87e-4595-a5db-bf231cc3ebd5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.211168 Sep 05 14:58:59.907280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1531/2924] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:58:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:58:59.911066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:59.911543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:59.911975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:59.912650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:58:59.913106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:58:59.913517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:58:59.983142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:59.991951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:59.993402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:58:59.994537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-437a19ff-8f6e-4d9f-ac63-29434860768a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093971 Sep 05 14:58:59.995134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1394/2925] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:58:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:00.922595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:00.923256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:00.928988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:00.929600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:00.929802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:00.930286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:00.930720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:00.931437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:00.932028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:00.932449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:00.936378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:00.936854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:00.937283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:00.937956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:00.938465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:00.938913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:01.128786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:01.130662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:01.137009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-eb8d111f-3d54-45b2-9425-8e902d257f18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218277 Sep 05 14:59:01.137582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1532/2926] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:01.139533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7a5524c4-f36f-48eb-ac43-72b6de0213a5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.214290 Sep 05 14:59:01.140241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1395/2927] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:01.142945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:01.143528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:01.149148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:01.149627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:01.150065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:01.150738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:01.152172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:01.152609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:01.215625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:01.224030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:01.225459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:01.226591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-749c91ad-8b4d-4ba5-84ad-94b750c8f559 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087505 Sep 05 14:59:01.227190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1533/2928] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:02.159951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:02.160583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:02.161323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:02.161935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:02.167047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:02.167526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:02.167960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:02.168418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:02.168645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:02.168910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:02.169098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:02.169834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:02.169988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:02.170551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:02.171051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:02.171477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:02.361833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:02.365055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:02.370312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-97fc8268-305f-47f8-924a-06d36e8cfd62 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214217 Sep 05 14:59:02.370901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1396/2929] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:02.373522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e88ab13e-039f-40bd-9cae-babd996735b5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216035 Sep 05 14:59:02.374200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1534/2930] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:02.375331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:02.375935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:02.381603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:02.382084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:02.382514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:02.383223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:02.383671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:02.384090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:02.444881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:02.453401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:02.454844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:02.455981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bac2ddf9-c63e-45d3-8a78-84a53a666921 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084173 Sep 05 14:59:02.456543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1397/2931] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:03.396382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:03.396933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:03.404092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:03.404267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:03.404703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:03.404831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:03.404991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:03.405708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:03.406156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:03.406598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:03.410988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:03.411467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:03.411900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:03.412587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:03.413038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:03.413460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:03.604011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:03.607386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:03.612581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c04747dc-1a8e-4d7a-a1cf-39797c8106a7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.220095 Sep 05 14:59:03.613151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1535/2932] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:03.616195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3082593f-8455-46a0-bab5-3233bdad8694 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215923 Sep 05 14:59:03.616934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1398/2933] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:03.618049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:03.618658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:03.624578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:03.625057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:03.629494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:03.629494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:03.629494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:03.629494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:03.692431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:03.701605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:03.703070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:03.704200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1d0916f4-6efa-4476-8c17-9710630eccdd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090140 Sep 05 14:59:03.704752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1536/2934] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:03 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:04.639955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:04.640552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:04.643348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:04.643970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:04.647172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:04.647656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:04.648091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:04.648775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:04.649224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:04.649692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:04.650421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:04.651000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:04.652509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:04.652509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:04.652763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:04.652857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:04.653100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:04.845628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:04.848400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:04.853853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-35109827-0d4a-401f-a720-df638f9f9485 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217740 Sep 05 14:59:04.854424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1399/2935] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:04.856374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8fc0ffe5-7b66-472e-814b-64dd099b209d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.217078 Sep 05 14:59:04.857488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1537/2936] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:04.859790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:04.860393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:04.866149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:04.866630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:04.867092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:04.867776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:04.868228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:04.868649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:04.928306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:04.936563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:04.938026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:04.939214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c0ac0bd8-690e-4c00-9409-584a5eb6a745 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083808 Sep 05 14:59:04.942993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1400/2937] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:05.877225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:05.877862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:05.879404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:05.880017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:05.884498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:05.884981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:05.885411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:05.886088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:05.886264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:05.886532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:05.886751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:05.886983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:05.887216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:05.888410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:05.888866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:05.889297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:06.077613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:06.085813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d1592c3f-f230-4276-86e5-d420a8ae9ccd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212377 Sep 05 14:59:06.086379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1538/2938] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:06.089742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:06.098062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e9954799-ddeb-4d04-ba2e-6b83c96abed1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.222472 Sep 05 14:59:06.098814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1401/2939] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:06.101699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:06.102301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:06.108034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:06.108501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:06.108932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:06.109603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:06.110044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:06.110462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:06.171008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:06.179441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:06.180863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:06.181992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1557b4e8-0a6f-433c-8449-f086c021aae0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084033 Sep 05 14:59:06.182551 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1539/2940] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:07.108750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:07.109356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:07.112075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=72 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:07.117871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:07.118362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:07.118823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:07.119529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:07.119985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:07.120233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:07.120705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:07.120906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:07.127754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:07.128798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:07.128798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:07.129312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:07.129759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:07.130177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:07.314172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:07.317982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:07.322632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6101a47c-1a88-4e3f-805e-cdeb41302a5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217721 Sep 05 14:59:07.323255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1402/2941] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:07.326439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-65674c6f-c7ab-42d0-ac11-c73be2e83d7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.209873 Sep 05 14:59:07.330692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1540/2942] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:07.331036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:07.331036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:07.334198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:07.334677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:07.335135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:07.335819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:07.336276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:07.336708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:07.397900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:07.406526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:07.407998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:07.409155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4915c071-3a26-4a2e-9dc6-dcb8ea6ff792 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084995 Sep 05 14:59:07.409706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1403/2943] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:08.346047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:08.346707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:08.349016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=78 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:08.349336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:08.350076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:08.354414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:08.354940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:08.355368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:08.356058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:08.356396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:08.356515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:08.356878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:08.357009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:08.357315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:08.358005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:08.358453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:08.358909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:08.548739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:08.555605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:08.556829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1da782ee-0db9-46f4-b38f-1684761aad8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214698 Sep 05 14:59:08.557397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1541/2944] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:08.562327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:08.562954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:08.564460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-87661a66-792e-470f-8959-32e0315c93b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.218992 Sep 05 14:59:08.565162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1404/2945] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:08 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:08.568731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:08.569214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:08.569640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:08.570319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:08.570768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:08.571210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:08.635748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:08.638502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:08.645369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:08.655700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:08.655700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70b699dc-3a69-4140-8ce8-9121926ea458 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089642 Sep 05 14:59:08.655700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1542/2946] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:08 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:09.580764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:09.581379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:09.587553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:09.587994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:09.588167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:09.588386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:09.588824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:09.589507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:09.589968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:09.590390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:09.595077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:09.595566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:09.596004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:09.596691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:09.597146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:09.597574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:09.779121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:09.783076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:09.787271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-643e6290-5de2-4611-a35e-106c9b51456d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210383 Sep 05 14:59:09.787831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1405/2947] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:09.791258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fa56a1a4-3988-4118-82fc-1ec7566dfb46 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.207547 Sep 05 14:59:09.791944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1543/2948] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:09.793375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:09.794478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:09.800165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:09.800640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:09.801066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:09.801737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:09.802181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:09.802596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:09.866318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:09.874730 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:09.876171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:09.877279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bce32a11-49db-4527-b761-497f2d735ea7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087626 Sep 05 14:59:09.877833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1406/2949] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:10.810682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:10.811469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:10.813894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:10.814515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:10.817962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:10.818435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:10.818885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:10.819571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:10.820014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:10.820428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:10.820841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:10.821356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:10.821792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:10.822467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:10.822948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:10.823373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:11.007243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:11.014260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:11.015985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-135204c3-0aab-49c2-b775-74daf52fba1a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209216 Sep 05 14:59:11.016554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1544/2950] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:11.021104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:11.021697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:11.022672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f24bc4f7-4698-4786-9c6d-2784b3066703 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212372 Sep 05 14:59:11.031524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1407/2951] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:11.031684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:11.031684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:11.031684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:11.031684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:11.032066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:11.032066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:11.090258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:11.099472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:11.100890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:11.102018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-058e9450-c150-4cd1-9124-9e1d5738c366 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084564 Sep 05 14:59:11.102567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1545/2952] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:12.039576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:12.040211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:12.045737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:12.046292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:12.047041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:12.047520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:12.047958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:12.048632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:12.049080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:12.049497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:12.052555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:12.053036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:12.053478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:12.054158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:12.054612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:12.055069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:12.244315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:12.247125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:12.252521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3f50f949-35d5-4e17-96d1-8697de89a475 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216795 Sep 05 14:59:12.253085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1408/2953] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:12.255704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-17d3d973-5dab-422b-b1ac-39ae6015f78f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.214288 Sep 05 14:59:12.256272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1546/2954] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:12.257471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:12.258055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:12.263863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:12.264609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:12.265040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:12.265708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:12.266352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:12.266770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:12.327246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:12.335891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:12.337305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:12.338421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-15030241-594a-4eef-be0d-93efe99726ff tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084433 Sep 05 14:59:12.338999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1409/2955] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:13.275756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:13.276399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:13.278766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:13.279391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:13.283059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:13.283545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:13.283982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:13.284668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:13.285122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:13.285545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:13.285674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:13.286054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:13.286482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:13.287192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:13.287636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:13.288055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:13.469816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:13.477970 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2249079e-bb14-4854-ba29-1213c0629ddc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.203110 Sep 05 14:59:13.478542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1410/2956] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:13 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:13.483457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:13.484047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:13.489706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:13.490186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:13.490616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:13.491690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:13.492161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:13.492565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:13.503519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:13.511735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6fe0f31-169a-458b-bc06-6f89d7bb3c18 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.239769 Sep 05 14:59:13.512298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1547/2957] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:13.553064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:13.562080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:13.563541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:13.564669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49a159c2-03ac-438e-9d92-131603aa6a53 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085194 Sep 05 14:59:13.565220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1411/2958] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:13 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:14.070557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.071082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.077503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.077995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.078433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.079157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.079615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.080039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.112094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:59:14.119330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.119330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.121917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.122407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.122977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.123731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.124262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.124599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.154421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 14:59:14.471427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5fce9cda-9551-482b-8c7c-52515f44fb75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 204 len: 0 microversion: 2.1 time: 0.361250 Sep 05 14:59:14.472098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1412/2959] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:59:14 2022] DELETE /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:59:14.480357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.481063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.483392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c7bcfe43-5c65-4ae5-9439-fc93525accf8 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 204 len: 0 microversion: 2.1 time: 0.416273 Sep 05 14:59:14.483988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1548/2960] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 14:59:14 2022] DELETE /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 0 bytes in 418 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 14:59:14.488084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.492039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.492039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.492039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.492039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.492435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.492696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.493395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.501273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.501752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.502181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.502902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.503384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.503807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.688026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:14.691692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:14.696535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5126c013-7d84-4a6d-8699-90d3be5ad878 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220050 Sep 05 14:59:14.700288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3640f560-67d3-4abd-b9d2-7b5d986abcfc tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1679 microversion: 2.1 time: 0.212018 Sep 05 14:59:14.700842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1549/2961] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:14 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:14.712466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1413/2962] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:14 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:14.716051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.716661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.717528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.718144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.723104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.723565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.724006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.724695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.725347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.725777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.725903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.726342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.726782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.727505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.727951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.728578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.734873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:14.921278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:14.924564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:14.929626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-205aa4f4-0325-49e6-91b2-afbdf4629926 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.227592 Sep 05 14:59:14.930368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1550/2963] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:14.932851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5835701e-ec18-4066-9956-9cce385b2ba6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219116 Sep 05 14:59:14.933559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1414/2964] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:14.935555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:14.936162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:14.941908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.942390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.942846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:14.943631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:14.944093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:14.944516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:15.191646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:15.191646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:15.193544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:15.193544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-47f77a94-21fc-4f89-a6a8-dbf3a4957890 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088923 Sep 05 14:59:15.193544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1551/2965] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:15.719629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:15.720309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:15.723087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:15.723723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:15.727074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:15.727664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:15.728163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:15.728944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:15.729569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:15.729995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:15.730351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:15.730868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:15.731306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:15.731989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:15.732438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:15.732870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.018163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.026594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8d447c64-1d7d-466e-a6ef-b93579bc0f3c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.311423 Sep 05 14:59:16.028048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1415/2966] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:15 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:16.046111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:16.046899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:16.052897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.053459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.053966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.054811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.055316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.055812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.057190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.066235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-33c4135e-36db-40d3-8946-d451e7a0691e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1679 microversion: 2.1 time: 0.347061 Sep 05 14:59:16.066854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1552/2967] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:15 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1679 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:16.071629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:16.072880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:16.082165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.082912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.083540 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.084240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.084890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.085317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.532974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.536409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.541394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1adf2ddc-de23-4e79-b513-94c45746cd29 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.513031 Sep 05 14:59:16.542036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1416/2968] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:16.545402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-11c282ac-0e3e-4e42-a475-71149c1a705e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.477266 Sep 05 14:59:16.547183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:16.547789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:16.555712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.556194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.556615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.557290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.557742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.558156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.560268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1553/2969] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:16.667058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.667058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.667312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:16.667312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-73d0939f-8b21-4845-983d-c039e21ea035 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.109250 Sep 05 14:59:16.667312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1417/2970] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:16.905640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-a36e5e2c-70d4-4ce0-ba53-e2c2f1443a19 req-0da811d5-506d-481c-a462-f3cbfd06de00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "79f81a66-3708-4a39-976c-ad76174a0cfe", "name": "network-vif-deleted", "tag": "23029087-5898-441d-a1d5-e195bd94e78e"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 14:59:16.915943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-a36e5e2c-70d4-4ce0-ba53-e2c2f1443a19 req-0da811d5-506d-481c-a462-f3cbfd06de00 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:16.921333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-a36e5e2c-70d4-4ce0-ba53-e2c2f1443a19 req-0da811d5-506d-481c-a462-f3cbfd06de00 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:16.921333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-a36e5e2c-70d4-4ce0-ba53-e2c2f1443a19 req-0da811d5-506d-481c-a462-f3cbfd06de00 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:16.929317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-a36e5e2c-70d4-4ce0-ba53-e2c2f1443a19 req-0da811d5-506d-481c-a462-f3cbfd06de00 service nova] Creating event network-vif-deleted:23029087-5898-441d-a1d5-e195bd94e78e for instance 79f81a66-3708-4a39-976c-ad76174a0cfe on hv-cinder-84290 Sep 05 14:59:16.934559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-a36e5e2c-70d4-4ce0-ba53-e2c2f1443a19 req-0da811d5-506d-481c-a462-f3cbfd06de00 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033073 Sep 05 14:59:16.935430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1554/2971] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 14:59:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 14:59:17.051880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:17.056371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:17.061300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.062055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.062492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.063232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.063768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.064245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.092967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:17.094041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:17.101178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.101769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.102428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.103472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.104010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.104608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.198403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c078e655c9454316aa7afe13a6b565e7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f14cb621ef04aa3a17159e418d6c7aa', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.214349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40791cda-55d2-45fd-916b-a7c54eae878f tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 200 len: 1325 microversion: 2.1 time: 0.127845 Sep 05 14:59:17.216940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1555/2972] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:17 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 1325 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:17.271723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.281592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8ac734b4-829c-44b1-a056-042361a3ced3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.235453 Sep 05 14:59:17.282090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1418/2973] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:17 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:17.565411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:17.566024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:17.569598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:17.570280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:17.572372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.572865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.573410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.574002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.574458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.574909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.577211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.577872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.578250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.579031 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.579553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.580038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.778520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.783801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.787702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7ed506eb-8e53-48b8-8b0e-b8706970f146 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.226085 Sep 05 14:59:17.788860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1556/2974] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:17.793690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:17.795048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:17.801773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.802487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.802675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3f29fed4-4f49-48ba-8941-75033109bf4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.236976 Sep 05 14:59:17.803306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.810887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1419/2975] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:17.811283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:17.811283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:17.811283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:17.884997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.887473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.888940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:17.890088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-94abaa58-1ce0-4c3d-af3f-8e7b0c228a1b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.100196 Sep 05 14:59:17.890646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1557/2976] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:18.237786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:18.238450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:18.245360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.245838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.246271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.247468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.247933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.248349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.262054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe HTTP/1.1 Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 14:59:18.264330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 14:59:18.266469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '79f81a66-3708-4a39-976c-ad76174a0cfe'} Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 14:59:18.267627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 14:59:18.269542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 14:59:18.271156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 14:59:18.271156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aeb8648d-6cbc-4bf2-b5f0-ed676aabf996 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 404 len: 111 microversion: 2.1 time: 0.031907 Sep 05 14:59:18.271156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1420/2977] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:18 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 14:59:18.276495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2fa299e5-594a-4f0f-896e-17540d6c3dcd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '.version_select at 0x7fb194cb1820>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:18.304834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:18.305511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:18.312076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.312555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.312987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.313669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.314118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.314540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.398442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2fa299e5-594a-4f0f-896e-17540d6c3dcd tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-750055755" status: 202 len: 0 microversion: 2.1 time: 0.125730 Sep 05 14:59:18.399065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1558/2978] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Sep 5 14:59:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-750055755 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 14:59:18.445197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:18.453976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-15c58297-7803-43fc-8e7e-b880a9c70dd5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152947 Sep 05 14:59:18.454674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1421/2979] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:18 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:18.813213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:18.813910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:18.819819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.820295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.820722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.821639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.821927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.822345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.828707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:18.829413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:18.835486 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.836059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.836766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.837595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:18.838127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:18.838644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:18.839962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:19.088169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:19.096186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:19.099384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b7f06d9f-8a5f-40b6-b528-5fc7806504bd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.290951 Sep 05 14:59:19.100704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1559/2980] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:18 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:19.105188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-860c3264-2fba-425b-9645-c84b14adcb2f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.281770 Sep 05 14:59:19.105932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1422/2981] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:19.111381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:19.112462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:19.120356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:19.125734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:19.125734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:19.125734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:19.125734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:19.126164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:19.185325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:19.193954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:19.195497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:19.196631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e11e2484-1abd-4459-9d15-7a9170661dbb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.094760 Sep 05 14:59:19.197291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1560/2982] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:19.477542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:19.478107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:19.485240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:19.485713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:19.486139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:19.486826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:19.487281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:19.487696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:19.616684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:19.625012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24c37233-b0b3-49a2-adb4-bb6c1517cc53 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151408 Sep 05 14:59:19.625571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1423/2983] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:19 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:20.122852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:20.123458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:20.128022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:20.128784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:20.129815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.130293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.130724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.131432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.131882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.132296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.134667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.135176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.135612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.136292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.136738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.137157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.329972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:20.334102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:20.338239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1fdbc47c-2d7e-4ea5-9bef-f675ea20e5e9 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.219191 Sep 05 14:59:20.338831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1561/2984] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:20.342954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-758ce4a7-94fd-4356-a612-3780a12b412c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218560 Sep 05 14:59:20.343226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:20.343792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1424/2985] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:20.343931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:20.349650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.350197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.350697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.351455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.351968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.352451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.414054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:20.422411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:20.423884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:20.425014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e9c5e4ba-fba8-4eeb-af30-b085b9ed49cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085287 Sep 05 14:59:20.425563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1562/2986] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:20.647737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:20.648296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:20.655804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.656278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.656707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.657385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:20.657861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:20.658276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:20.784160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:20.792228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a8e31c46-111d-4803-af73-59f334b2cf29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148432 Sep 05 14:59:20.792784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1425/2987] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:20 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:21.362294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:21.362848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:21.365186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:21.365830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:21.369659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.370137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.370573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.371288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.371739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.372130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.372262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.372612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.373050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.373732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.374187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.374611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.566266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:21.569058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:21.574585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-39d7bf0a-6b34-43cb-bf64-6519fa48aaed tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216357 Sep 05 14:59:21.575679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1563/2988] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:21.577654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-62739849-8570-4c71-a9d1-fb1a66a7d34b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216290 Sep 05 14:59:21.578358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1426/2989] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:21.580330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:21.580930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:21.588070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.588809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.589453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.590439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.591564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.591987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.657189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:21.665711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:21.667178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:21.668299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-161f5b88-c7f2-4090-9de9-a23dfa33127a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091723 Sep 05 14:59:21.668872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1564/2990] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:21.815467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:21.816182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:21.822449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.822976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.823462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.824145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:21.824596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:21.825017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:21.953330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:21.961605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8d588587-1f10-4965-9e61-8c39ba36c4d0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150037 Sep 05 14:59:21.962177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1427/2991] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:21 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:22.597971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:22.598592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:22.600417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:22.601036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:22.605121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.605604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.606047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.607392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.607706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.607838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.608188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.608314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.608670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.609357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.609808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.610231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.801012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:22.804964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:22.809152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-16cc9cba-6378-4dee-a387-d1bcef3dc1f4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215053 Sep 05 14:59:22.809773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1565/2992] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:22.813424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4f03b35c-0683-4fab-a955-ff5444c3927e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216952 Sep 05 14:59:22.814173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1428/2993] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:22.814336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:22.814938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:22.820708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.821186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.821614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.822290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.822736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.823178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.883568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:22.891918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:22.893346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:22.894459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f2e4741f-9963-45f5-bbad-bba0030a239f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.083787 Sep 05 14:59:22.895049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1566/2994] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:22.984376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:22.985017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:22.991802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.992280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.992711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:22.993388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:22.993841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:22.994259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:23.124219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:23.132352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f9214cfc-ccf6-42b4-8c8c-c62662f8ef31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151863 Sep 05 14:59:23.132858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1429/2995] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:22 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:23.833207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:23.833822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:23.837511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:23.838125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:23.840255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:23.840738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:23.841527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:23.842218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:23.842676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:23.843130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:23.844525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:23.845000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:23.845425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:23.846103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:23.846548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:23.847000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:24.025108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:24.033377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2db7ea63-32ff-4a24-8dba-71c69d60958a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.204012 Sep 05 14:59:24.034029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1567/2996] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:24.035919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:24.038640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:24.039278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:24.045406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56bafd14-1a0a-4eb5-8904-d89cdcb908a4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212322 Sep 05 14:59:24.045588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:24.045923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:24.046467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1430/2997] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:24.046590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:24.047059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:24.047515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:24.047940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:24.112621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:24.121650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:24.123174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:24.124328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f11d3891-c56f-4aa0-9628-1f8af1bd818c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089278 Sep 05 14:59:24.124884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1568/2998] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:24 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:24.156083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:24.156704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:24.162724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:24.163245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:24.163686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:24.164374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:24.164830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:24.165256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:24.180649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:24.292939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:24.301619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b3cceaf1-76dc-40b7-9b52-0c11aef82158 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150009 Sep 05 14:59:24.302172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1431/2999] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:24 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:25.057270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:25.057935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:25.064908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.065394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.065834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.066515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.067005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.067431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.068849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:25.069488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:25.076841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.077324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.077752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.078476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.079100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.079521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.267610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:25.271611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:25.276133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bfbc9b02-15ec-49d2-b71d-d8d5f62f539d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.222733 Sep 05 14:59:25.276702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1569/3000] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:25.280101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6746fadf-bb20-4de2-9e61-038822b24cd3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215018 Sep 05 14:59:25.281103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:25.281704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:25.284315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1432/3001] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:25.287423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.287903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.288336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.289017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.289469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.289890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.324361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:25.324932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:25.330886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.331379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.331816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.332509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:25.332966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:25.333393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:25.350638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:25.359729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:25.361156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:25.362282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ad269e70-ae17-4996-aa0e-fa2f7dd34b1f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.084678 Sep 05 14:59:25.363089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1570/3002] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:25.463929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:25.472320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c7887909-12a8-4fc7-8bac-45d7bab7c535 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151818 Sep 05 14:59:25.472888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1433/3003] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:25 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:26.299480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:26.300089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:26.303426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:26.304046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:26.306759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.307278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.307713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.308400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.308855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.309281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.311057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.311541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.311979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.312671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.313242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.313646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.497094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:26.501033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:26.505401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-32c25d4d-157a-465f-b0cf-20ed72fde6cf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.209774 Sep 05 14:59:26.505987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1571/3004] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:26.508910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-715e268d-51aa-4ba4-ad04-543800d03a74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209347 Sep 05 14:59:26.518992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1434/3005] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:26.519161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:26.519161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:26.519369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:26.519369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:26.519550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.519550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.519550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.519550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.519913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.519913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.520088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.520442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.521774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.521774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:26.522003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:26.522297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:26.591774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:26.600223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:26.601644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:26.602824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70494ec7-a520-4137-bb97-1e473ac461a0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095915 Sep 05 14:59:26.603385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1572/3006] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:26.673456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:26.681643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-76c4e15f-f65b-410b-aa86-4987a48a0125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.171249 Sep 05 14:59:26.682302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1435/3007] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:26 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:27.529616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:27.530222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:27.533998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:27.534651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:27.536659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.539766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.539766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.539766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.539766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.540262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.541236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.541720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.542160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.542903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.543374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.543834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.732726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:27.736587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:27.741313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-02c302f7-3bd0-4910-b96a-c71165966c87 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215887 Sep 05 14:59:27.741879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1573/3008] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:27.745267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8859baef-9dc2-444f-ac5e-db7e0ae9a6d4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215162 Sep 05 14:59:27.746084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1436/3009] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:27.751193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:27.751556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:27.752234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:27.752477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:27.758488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.758763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.759013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.759455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.759587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.760051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.760168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.760585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.760809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:27.761011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.761324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:27.761744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:27.847881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:27.856997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:27.858423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:27.859592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-df388b88-d914-4b67-b0e7-355dff818c8b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.112046 Sep 05 14:59:27.860146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1574/3010] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:27.919422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:27.924354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-26c9dcd8-b15e-4765-b096-06252c08dfb0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.177480 Sep 05 14:59:27.924917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1437/3011] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:27 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:28.764663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:28.765285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:28.768038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:28.768646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:28.772003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.772282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.772722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.773414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.773872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.774297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.774972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.775451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.775883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.776563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.777010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.777425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.967849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:28.971733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:28.975911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f805f054-88d2-45e4-a9af-3bae8536d4f8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215239 Sep 05 14:59:28.976477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1575/3012] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:28 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:28.979797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4832667-5dc5-469f-a009-5d32c679b1e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215586 Sep 05 14:59:28.992620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1438/3013] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:28.992820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:28.992820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:28.993058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:28.993058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:28.993265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.993265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.993265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.993265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.993684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.993684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.993873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.993873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.993873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:28.993873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:28.994227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:28.994328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:28.994718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:29.076050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:29.084785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:29.086335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:29.087495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d33a9eff-42ca-4b18-aeac-923be355967d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.110120 Sep 05 14:59:29.088252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1576/3014] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:28 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:29.146673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:29.154202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e894d7b5-1e20-4c72-81f9-66615530e613 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.172437 Sep 05 14:59:29.154765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1439/3015] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:28 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:30.000313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:30.000903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:30.005187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:30.005805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:30.007353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.007831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.008257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.008938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.009380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.009799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.012199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.012744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.013185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.013874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.014331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.014756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.201113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:30.206019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:30.210074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6dbcbc32-00fd-4e0a-8df4-69e6044a09db tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.214148 Sep 05 14:59:30.210647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1577/3016] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:30.214210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9707cd4a-458e-498d-9e5b-39b48f85f780 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212899 Sep 05 14:59:30.226859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1440/3017] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:30.227066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:30.227066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:30.227277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:30.227277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:30.227443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.227443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.227443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.227443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.227785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.227785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.227956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.227956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.227956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.228228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:30.229705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:30.229705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:30.307432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:30.315912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:30.317348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:30.318504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-be0eb323-4940-4d17-bd19-9281a6708ad8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.106905 Sep 05 14:59:30.319102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1578/3018] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:30.376359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:30.384460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a47d4f70-6399-4545-8c6b-65f2f1c76eab tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.167980 Sep 05 14:59:30.385020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1441/3019] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:30 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:31.234910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:31.235538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:31.237836 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:31.238449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:31.242632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.243153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.243590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.244276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.244728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.244996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.245151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.245477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.245911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.246596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.247729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.248158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.437922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:31.444455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:31.446261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-408613f5-63f7-4886-9a87-f7272805a498 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215813 Sep 05 14:59:31.447050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1579/3020] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:31.450920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2a10434-7900-487b-bfe3-e52acf82e505 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216819 Sep 05 14:59:31.451515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:31.452112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:31.457879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.458367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.458819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.459515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.459971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.460402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.463162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1442/3021] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:31.471819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:31.476424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:31.479073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.479551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.479977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.480655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:31.481100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:31.482005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:31.524243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:31.533360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:31.542736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:31.542736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-346000e3-6973-4589-8ec2-62f336791087 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088303 Sep 05 14:59:31.542736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1580/3022] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:31.617000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:31.624961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e51dce56-6616-4aa4-883f-012993bc7896 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.160628 Sep 05 14:59:31.625514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1443/3023] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:31 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:32.469265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:32.469907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:32.476639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.477124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.477267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:32.477690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.477814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:32.478375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.478862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.479323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.484668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.485146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.485581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.486273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.486724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.487180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.677763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:32.681686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:32.686767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6f091bba-7173-4327-9baa-81134aae5f6f tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.221368 Sep 05 14:59:32.687556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1581/3024] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:32.690817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4d94d277-a731-4d23-94a0-d6fadb22ac8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217304 Sep 05 14:59:32.692151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:32.692751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:32.698400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.698924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.699353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.700028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.700494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.701093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.704942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1444/3025] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:32.709723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:32.710327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:32.716106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.716580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.717005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.717683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:32.718128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:32.718546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:32.765011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:32.773675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:32.775131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:32.776271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a137895e-2265-40dd-a8fe-53e69f5d21f0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088002 Sep 05 14:59:32.776834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1582/3026] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:32.860896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:32.869205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7f688b2-9ab5-4846-9afa-3df758294f56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.163114 Sep 05 14:59:32.869761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1445/3027] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:32 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:33.710595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:33.711272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:33.713413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:33.714147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:33.718430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.718977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.719439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.720132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.720583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.721004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.721143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.721487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.721912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.722591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.723084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.723505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.911993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:33.914711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:33.920265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9d479d9e-9c18-44b1-bb50-26d831bfe47a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.213666 Sep 05 14:59:33.920833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1583/3028] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:33 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:33.922767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8e177113-87c1-4bbd-8f7d-a4165f75e0b0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213278 Sep 05 14:59:33.934880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1446/3029] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:33.935043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:33.935043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:33.935250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:33.935250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:33.935510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.935510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.935685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.935784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.935884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.935884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.936054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.936054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.936229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:33.936327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:33.936418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:33.936834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:34.019071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:34.027494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:34.028932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:34.030054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-110fa4be-c443-402b-a5a5-e3812aac1741 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.107608 Sep 05 14:59:34.030603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1584/3030] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:33 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:34.084719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:34.092995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a7b56f92-d656-41eb-8498-9f66f30fd626 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.168718 Sep 05 14:59:34.093651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1447/3031] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:33 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:34.943913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:34.944495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:34.948100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:34.948755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:34.951339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:34.951827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:34.952253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:34.952938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:34.953387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:34.953808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:34.954894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:34.955377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:34.955815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:34.956505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:34.956956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:34.957379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:34.959971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:35.369793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:35.376911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:35.378043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6e19db8f-f187-4ee7-b4f6-061ad3d1551a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.438710 Sep 05 14:59:35.378612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1585/3032] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:35.383080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:35.383674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:35.389360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:35.389836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:35.390266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:35.390661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6ff6f62f-c750-4ed8-b496-e6b4883b8a73 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.446439 Sep 05 14:59:35.390975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:35.391621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:35.391761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1448/3033] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:35.391871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:35.400167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:35.400843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:35.402672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:35.408793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:35.409356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:35.409862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:35.410748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:35.411276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:35.411767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:35.461757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:35.471057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:35.472478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:35.473612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ecb1c19-de4a-4b52-b74b-21bd74bbb602 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.094062 Sep 05 14:59:35.474468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1586/3034] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:35.551825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:35.560131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6598738d-63aa-4333-be64-ad4759e23b7c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.165005 Sep 05 14:59:35.560704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1449/3035] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:36.400976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:36.401558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:36.403787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:36.408440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.408917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.409346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.410024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.410474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.410942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.414675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:36.415323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:36.422093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.422574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.423093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.423784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.424252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.424660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.611472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:36.615395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:36.619965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-97cd21ff-700f-4e91-8046-5eb5913e0277 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.222967 Sep 05 14:59:36.620536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1587/3036] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:36.624484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ad731c98-e0de-49d4-8cb7-f22dd84a494e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213510 Sep 05 14:59:36.625512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1450/3037] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:36.629904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:36.630498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:36.636101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.636577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.637011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.637683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.638130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.638545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.639474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:36.640106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:36.645992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.652412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.652412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.652412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:36.652412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:36.652835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:36.727787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:36.737074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:36.738527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:36.739702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f0b7f12a-2c20-4806-b139-9fd2f214f1bd tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.118242 Sep 05 14:59:36.740300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1588/3038] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:36.791778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:36.800432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bc61b3a1-9ddd-457b-b010-65708dc556c8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.173955 Sep 05 14:59:36.801034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1451/3039] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:37.643362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:37.643958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:37.650482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.650999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.651433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.652120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.652588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.652713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:37.653675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.653798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:37.659999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.660470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.660908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.661584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.662029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.662449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.847546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:37.850597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:37.856074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-56a1a713-5ccd-42c2-b09f-a658ab995a64 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216558 Sep 05 14:59:37.857273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1589/3040] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:37.859373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8992c8d1-3c1a-461d-bd19-046b6fc02f94 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210501 Sep 05 14:59:37.860059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1452/3041] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:37.861980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:37.862575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:37.864340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:37.865300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:37.870934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.871391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.871830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.872523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.872843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.872968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.873375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.873912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.874682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.875797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:37.876356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:37.876920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:37.960311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:37.969461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:37.970924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:37.972066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4cb4652a-a9b6-44df-9406-0af553b8c9be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.113893 Sep 05 14:59:37.972618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1590/3042] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:38.026377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:38.035006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0cab49fc-0b52-42e2-b63c-b4edf2608284 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.174062 Sep 05 14:59:38.035566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1453/3043] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:37 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:38.882054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:38.882695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:38.885154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:38.885761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:38.889198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:38.889675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:38.890109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:38.890847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:38.891300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:38.891722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:38.892108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:38.892585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:38.893016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:38.893688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:38.894139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:38.894554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:39.086178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:39.088986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:39.095349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5223cc5d-258e-4f0f-9193-0507dd8c6d24 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.213984 Sep 05 14:59:39.103573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1454/3044] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:38 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:39.103573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:39.103573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:39.108034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:39.108508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:39.108941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:39.109605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:39.110176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:39.110308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-614f926e-b8e6-41f2-82cc-d3ba87cba57f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.232038 Sep 05 14:59:39.110597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:39.111258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1591/3045] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:39.115519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:39.116192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:39.122017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:39.122615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:39.123106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:39.123791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:39.124244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:39.124662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:39.174611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:39.183284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:39.184761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:39.185899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d8f5ece3-5038-4e36-8f4f-94fe6a1ba3bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088946 Sep 05 14:59:39.186491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1455/3046] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:39.268602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:39.270872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:39.277351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9d19d633-da92-45ee-86ac-c5eff40d77b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.165531 Sep 05 14:59:39.278431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1592/3047] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:39 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:40.118958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:40.119574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:40.126542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.127059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.127500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.128197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.128636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.129061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.133241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:40.133850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:40.141233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.141708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.142138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.142841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.143291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.143714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.308178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:40.316842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ff99db75-ef1b-4a5a-8e31-e3c9b39c1c12 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.201987 Sep 05 14:59:40.317487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1456/3048] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:40.321897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:40.322536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:40.328320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.328672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.329109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.329803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.330262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.330689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.331751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:40.340337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0ea372e6-d6e2-4d43-a85c-ef434c42f153 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210880 Sep 05 14:59:40.345555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1593/3049] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:40.345555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:40.345951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:40.352955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.353436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.353869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.354546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:40.355021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:40.355436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:40.403964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:40.412627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:40.414104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:40.415275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f401eae-d526-4142-85c1-74adb3474baa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.096870 Sep 05 14:59:40.416030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1457/3050] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:40.490841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:40.499836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1c09c0d7-07f6-4e02-b5ca-cf41beedbb41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.157906 Sep 05 14:59:40.500394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1594/3051] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:41.340186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:41.340813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:41.347286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.347714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.348149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.348832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.349284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.349706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.363424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:41.364629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:41.371346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.372318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.372755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.373444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.373903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.374326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.548407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:41.552427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:41.557552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9fe7d755-7c57-43b3-a4aa-5ab6c69665ba tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.221172 Sep 05 14:59:41.558156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1458/3052] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:41.561389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-19215bbf-d95f-4bd8-b285-eae0ad6bca7b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.201787 Sep 05 14:59:41.574857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1595/3053] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:41.575543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:41.575543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:41.575744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:41.575744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:41.575926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.575926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.575926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.575926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.576260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.576260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.576423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.576423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.576423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.576423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:41.576782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:41.576782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:41.656538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:41.664997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:41.666498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:41.667662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7d71048-117e-475d-b605-ba724a5e224a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.108487 Sep 05 14:59:41.668956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1459/3054] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:41.722833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:41.731475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-340d01fb-2033-4d93-a58c-1eb5c61a24f3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.168071 Sep 05 14:59:41.732012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1596/3055] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:41 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:42.582211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:42.582900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:42.584868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:42.591803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:42.592393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.592393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.592393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.592393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.592769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.592882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.593015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.593109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.593501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.594190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.594647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.595099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.787847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:42.792491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:42.796962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-606f29d5-f5bc-43eb-99e1-43e4dc9b3ea7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215916 Sep 05 14:59:42.798821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1597/3056] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:42.801150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e516bb3e-6792-4f3f-b652-bbb5530ad2ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.223221 Sep 05 14:59:42.802555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:42.803184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:42.808961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.809933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.810360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.811082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.811526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.811942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.815105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1460/3057] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:42.820324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:42.820936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:42.827996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.828875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.829017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.829712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:42.830315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:42.830851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:42.883531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:42.893365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:42.895348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:42.896494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5252db85-b9e2-41ae-8388-3e08c8c44794 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.097576 Sep 05 14:59:42.897208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1598/3058] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:42.978406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:42.986480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-629e074e-a27a-48bf-befc-1f42257e6866 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.170016 Sep 05 14:59:42.987074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1461/3059] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:42 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:43.820568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:43.821177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:43.823710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:43.824316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:43.827612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:43.828086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:43.828514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:43.829194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:43.829671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:43.830054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:43.830417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:43.830936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:43.831375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:43.832066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:43.832521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:43.832947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:44.020480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:44.023349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:44.029723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fd8463f3-1815-48a5-a370-600e0222d8c4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213082 Sep 05 14:59:44.030282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1599/3060] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:44.032338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-30f3354b-8a45-45eb-9ffc-e3615ba635e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.212639 Sep 05 14:59:44.032897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1462/3061] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:43 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:44.034879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:44.035478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:44.037724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:44.038487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:44.041127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:44.041886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:44.042474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:44.043362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:44.043977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:44.044330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:44.044558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:44.045145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:44.045749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:44.046428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:44.046907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:44.047518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:44.112877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:44.121651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:44.123846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:44.124290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0817663f-64f2-49ef-b1e8-4e7fec480ce3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093074 Sep 05 14:59:44.135052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1600/3062] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:44.198476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:44.207293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-225edd38-d9ff-4327-afa5-5c9939993802 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.173191 Sep 05 14:59:44.207835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1463/3063] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:44 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:45.053320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:45.053916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:45.055523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:45.056134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:45.060873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.061345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.061769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.062445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.062925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.063038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.063346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.063460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.063820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.064500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.064953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.065376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.251935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:45.255856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:45.258036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:45.260190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0bbaf846-eabc-42d4-a593-9a6bed3377b3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210740 Sep 05 14:59:45.260758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1601/3064] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:45.265543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9e441c5b-7533-481b-a660-5d9b306f8c18 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.213845 Sep 05 14:59:45.265767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:45.267269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1464/3065] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:45.268571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:45.271017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:45.271632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:45.272240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.272727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.273167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.273856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.274367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.274782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.277343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.277841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.278844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.279765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:45.280393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:45.280987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:45.347916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:45.357200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:45.358829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:45.360043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8aafbf10-17ab-4bf3-b141-11d9a0443ea8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.098375 Sep 05 14:59:45.360607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1602/3066] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:45.429913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:45.437959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-df40d412-1294-4cc1-b1b0-2a58abbee2fd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.170641 Sep 05 14:59:45.438507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1465/3067] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:45 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:46.297180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:46.297790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:46.297921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:46.298411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:46.303798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.304273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.304701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.304877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.305358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.305482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.305792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.305912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.306215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.306471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.306951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.307377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.496528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:46.500622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:46.505022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cfefaee2-bb06-4392-aef6-15cb9d572d85 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.211720 Sep 05 14:59:46.505593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1603/3068] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:46.509067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb8eba17-2fdd-4105-af8d-b8583a3eddda tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215038 Sep 05 14:59:46.509831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1466/3069] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:46.509958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:46.510690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:46.520221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:46.520221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:46.520444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.520444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.520444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.520444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.520804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.520804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.522473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.522999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.523442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.524132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:46.524922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:46.525068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:46.604930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:46.613499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:46.615003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:46.616130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7aa7e52a-6d99-4f20-99af-4a4f68d8eccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.109643 Sep 05 14:59:46.616944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1604/3070] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:46.674374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:46.682475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9ada4889-7a6e-4eca-b774-3a1c7ab76125 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.170464 Sep 05 14:59:46.683073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1467/3071] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:47.529732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:47.530327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:47.536753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.537234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.537671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.538357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.538840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.539267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.542652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:47.544131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:47.550321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.550808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.551247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.551930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.552378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.552795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.740432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:47.744609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:47.749166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-25cd3c34-f9e5-48af-830d-623534251e93 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.224335 Sep 05 14:59:47.749743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1605/3072] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:47.752832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ffe57e63-36f2-465a-8fef-08f2d0c29586 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214082 Sep 05 14:59:47.753392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1468/3073] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:47.754223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:47.754857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:47.758229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:47.759033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:47.761820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.763036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.763651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.764589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.765285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.765944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.768166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.768651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.769083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.769772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:47.770221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:47.770850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:47.834746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:47.843936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:47.845365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:47.846523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-153e2fa9-98e0-403f-bd66-5de3e71f0d40 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095826 Sep 05 14:59:47.847253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1606/3074] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:47.919533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:47.927929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-89d6f33a-43cf-4744-b46d-35cb2ee4dcf7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.173405 Sep 05 14:59:47.928499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1469/3075] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:47 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:48.773385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:48.773990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:48.777213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:48.777860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:48.780785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 14:59:48.780933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 14:59:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 (ip 10.222.0.15) !!! Sep 05 14:59:48.781125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:48.782393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:48.783231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:48.783965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:48.784432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:48.784859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:48.787240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:48.787721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:48.788153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:48.788841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:48.789293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:48.789713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:49.078925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:49.085417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:49.087448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-181bc54d-caed-4d63-9f15-f989f2ffa0e9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.313968 Sep 05 14:59:49.088023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1470/3076] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:49.093771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c534b2f9-bbb7-46af-b892-799044ac5189 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.324196 Sep 05 14:59:49.102688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1607/3077] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:48 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:49.103039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:49.103039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:49.103243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:49.103243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:49.104676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:49.105154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:49.105299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:49.105637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:49.105766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:49.106065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:49.106379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:49.106742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:49.106896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:49.107222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:49.107369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:49.107640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:49.199418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:49.208575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:49.210425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:49.211674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24696cfa-4299-4003-904d-023fc171ca92 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.122731 Sep 05 14:59:49.212235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1471/3078] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:49.264265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:49.272503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b34574d8-22d8-496f-ba0f-50de0978239d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.177171 Sep 05 14:59:49.273067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1608/3079] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:50.109474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:50.110110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:50.115686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:50.116323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:50.116786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.117253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.117677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.118357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.118828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.119253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.123124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.123672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.124185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.124934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.125387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.125805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.141358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:50.304303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:50.313019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3aeae8a3-41cc-4b24-9c82-735cb51e931e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.207244 Sep 05 14:59:50.313431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1472/3080] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:50.318257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:50.318862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:50.319025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:50.325425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.325912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.326343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.327056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.327509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.327931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.328189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce206092-8940-43e0-8864-7d5cf9a6722a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.216166 Sep 05 14:59:50.330835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1609/3081] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:50.333166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:50.333923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:50.339672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.340156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.340594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.341278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:50.341732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:50.342155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:50.391361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:50.400343 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:50.401784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:50.403482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7585e915-8ac4-4a82-87e1-dfa34e0ca0bf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088588 Sep 05 14:59:50.404033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1473/3082] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:50.483178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:50.491239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f40ba3cc-07f9-4f1f-b75d-186991844c40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.161511 Sep 05 14:59:50.492065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1610/3083] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:51.336782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:51.337384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:51.344291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.344765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.345197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.345870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.346368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.346735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.350050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:51.350662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:51.357635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.358113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.358547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.359264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.359727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.360151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.544391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:51.548445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:51.552567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1abce50c-a344-42ee-b031-4e7a106dbb5b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219565 Sep 05 14:59:51.553136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1474/3084] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:51.556754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e80705a5-873d-44ef-b048-7a6304cfd913 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.210503 Sep 05 14:59:51.557508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1611/3085] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:51.557642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:51.558095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:51.562991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:51.563844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.564106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:51.564303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.564734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.565411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.565854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.566277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.572420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.572912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.573350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.574048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:51.574507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:51.575495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:51.634630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:51.643733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:51.645161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:51.646299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5d044e1c-ce52-494b-b94b-d1fc4c899770 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092259 Sep 05 14:59:51.646885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1475/3086] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:51.721275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:51.729624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b83d48e8-e902-453c-9da7-3bd5889cec57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.170478 Sep 05 14:59:51.730530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1612/3087] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:51 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:52.576036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:52.576649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:52.579362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:52.579978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:52.583790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.584108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.584537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.585225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.585691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.586076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.586198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.586559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.587023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.587741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.588198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.588624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.779891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:52.782834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:52.788295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d12888d3-d089-42ab-8eba-0776c16ee50d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216153 Sep 05 14:59:52.788859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1476/3088] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:52.791056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-74e306cd-dfa0-45c2-8749-7db1ae70ad3c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.215526 Sep 05 14:59:52.802908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1613/3089] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:52.803103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:52.803103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:52.803318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:52.803318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:52.803494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.803494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.803494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.803494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.803842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.803956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.804077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.804171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.804171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.804560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:52.805012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:52.805429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:52.892270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:52.900944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:52.902384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:52.904090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18af8e04-97da-45f0-8c58-c3ff9cc721b5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.114191 Sep 05 14:59:52.904634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1477/3090] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:52.953347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:52.961480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6beab247-7e62-45ca-a63f-daa13c1da249 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.168675 Sep 05 14:59:52.962034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1614/3091] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:52 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:53.811631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:53.812223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:53.816900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:53.817515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:53.818589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:53.819098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:53.819529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:53.820211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:53.820660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:53.821076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:53.823857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:53.824335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:53.825265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:53.825942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:53.826396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:53.826835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:53.967466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:53.975795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2a777138-bf7e-42ff-9bb8-d151c64d2c38 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.162698 Sep 05 14:59:53.976359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1615/3092] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:53 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:53.980925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:53.981522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:53.987505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:53.988330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:53.988471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:53.989094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:53.989614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:53.990041 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:54.063650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:54.072223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:54.073654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:54.075497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c30bbde4-fc84-4321-a044-265be77b90fa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.097602 Sep 05 14:59:54.079295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1616/3093] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:53 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:54.080401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:54.081004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:54.087037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:54.087517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:54.087942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:54.088620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:54.089067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:54.089481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:54.138951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:54.147155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e346c379-d11b-4705-878e-4bac96a40d0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.339363 Sep 05 14:59:54.147719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1478/3094] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:54.224598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:54.232856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b1a42fd-46f2-4fa4-acb4-4d1f49b4c0a7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.155891 Sep 05 14:59:54.233412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1617/3095] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:54 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:55.000755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:55.001364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:55.007739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.008223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.008658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.009347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.009804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.010229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.100997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:55.101606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:55.108647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.109124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.109559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.110238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.110685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.111131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.136726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:55.145256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b32c13b2-986e-4c19-b5cf-b3ceb4bfbb73 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148499 Sep 05 14:59:55.145821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1479/3096] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:55.170560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:55.171284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:55.176025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:55.177465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.177961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.178479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.179344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.179862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.180324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.184686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:55.186134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:55.187300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bc9113cb-0ec1-4424-83f7-fc117a77e60d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090180 Sep 05 14:59:55.187850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1618/3097] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:59:55.256394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:55.256956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:55.263475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.263961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.264399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.265083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:55.265538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:55.265961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:55.315796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:55.323977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-caa451f0-a47f-4a78-bedc-a68e32f0812d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.158013 Sep 05 14:59:55.325037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1480/3098] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:55.397564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:55.406406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90b0acc3-ee11-4ccc-80c3-07f2ba3ab0cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153934 Sep 05 14:59:55.406995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1619/3099] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:55 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:56.169451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:56.170059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:56.176487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.176969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.177405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.178087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.178541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.178998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.193926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:56.213121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:56.213848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:56.220308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.220792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.221226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.221919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.222400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.222931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.299821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:56.308414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:56.310427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:56.311589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd143cd8-db33-474e-8e43-94b08a38d5c1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.102333 Sep 05 14:59:56.312145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1620/3100] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 14:59:56.329233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:56.337445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06739b72-c43b-4e06-bb97-41a7b2bf6dff tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172387 Sep 05 14:59:56.337987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1481/3101] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:56.347167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:56.347813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:56.353746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.354223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.354655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.355379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.356451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.356886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.428437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:56.429138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:56.435218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.435700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.436132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.436814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:56.437262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:56.437682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:56.512297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:56.520421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-26a0d72e-d7c1-4f9d-b55c-c43a88a000cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.177089 Sep 05 14:59:56.520994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1621/3102] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:56.575527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:56.583591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-78a7f815-7f3b-4f5c-904e-65d49e969a73 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.159036 Sep 05 14:59:56.584138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1482/3103] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:56 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:57.336669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:57.337297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:57.343674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.344145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.344572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.345244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.345696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.346161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.360577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:57.361187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:57.367951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.368436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.368873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.369620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.370072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.370493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.410130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:57.419213 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:57.420640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:57.421767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d4af5b2-5dfa-485f-8de2-39d660cd7e8f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089086 Sep 05 14:59:57.422320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1622/3104] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:57.501539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:57.509522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3524cf67-5ff3-446d-a5c7-405584c79312 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.152798 Sep 05 14:59:57.510070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1483/3105] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:57.544035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:57.544662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:57.550511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.551100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.551531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.552207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.552654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.553071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.607142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:57.607655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:57.613517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.613990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.614419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.615160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:57.615608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:57.616028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:57.722984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:57.731844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3b0d656-d4f2-47dd-8857-203c6d395357 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.192046 Sep 05 14:59:57.732613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1623/3106] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:57.767244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:57.775444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d5a9c02e-d540-4b99-90c8-e5846030a50b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.172776 Sep 05 14:59:57.775991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1484/3107] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:57 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:58.447542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:58.448078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:58.454932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.455409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.455838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.456514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.457004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.457422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.523275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:58.532433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:58.533177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:58.533820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:58.533955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:58.534993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3399633-544d-45dc-8117-955799e6b848 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091507 Sep 05 14:59:58.535546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1624/3108] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:58 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:58.540418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.540898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.541333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.542015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.542498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.542950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.670337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:58.678388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-be53bb6e-a3f1-403e-92e8-69af9eed9ca6 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.148999 Sep 05 14:59:58.678964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1485/3109] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:58 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:58.755252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:58.755858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:58.762930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.763410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.763835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.764507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.764952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.765364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.797339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:58.797945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:58.803960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.804435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.804862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.805543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:58.805987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:58.806402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:58.943575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:58.951694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-243f4a85-609c-4bf5-ad41-585bca2d03e7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.200303 Sep 05 14:59:58.952256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1625/3110] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 14:59:58.968524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:58.976800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6e8ae4d5-e55b-4ae9-a6f1-d7aaa1cdfee8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.183253 Sep 05 14:59:58.977353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1486/3111] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:58 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 14:59:59.559675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:59.560282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:59.566635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:59.567140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:59.567570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:59.568242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:59.568694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:59.569107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:59.571618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 14:59:59.632499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:59.640870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:59.642559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:59.643715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-27baaeb3-346d-423b-81e6-9e9a61a8c7f7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087993 Sep 05 14:59:59.644263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1626/3112] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 14:59:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 14:59:59.702136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 14:59:59.702778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 14:59:59.709139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:59.709614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:59.710047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:59.710756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 14:59:59.711229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 14:59:59.711648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 14:59:59.840877 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 14:59:59.848938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7b600fa8-3e24-433c-8d07-f9d7a2a5da14 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151428 Sep 05 14:59:59.849491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1487/3113] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:00.094181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:00.095004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:00.100952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.101375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.101812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.102502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.102991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.103417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.138614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:00.139248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:00.145187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.145686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.146118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.146813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.147271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.147686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.274949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:00.283022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ee105b2a-5f59-40d1-aa16-31b5c21fc3df tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.311504 Sep 05 15:00:00.283778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1627/3114] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:00.302941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:00.311524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-93aa5f06-8842-4c2e-ae20-42688d14bc9e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.315086 Sep 05 15:00:00.312081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1488/3115] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 14:59:59 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:00.668025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:00.669133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:00.675619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.676101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.676541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.677224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.677676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.678098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.743275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:00.752342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:00.753790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:00.754991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c2af7224-1c2d-4a82-bae0-5f7afb2fbc0d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090800 Sep 05 15:00:00.755550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1628/3116] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:00.872670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:00.873271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:00.880101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.880577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.881005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:00.881678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:00.882123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:00.882538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.006614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:01.015141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55e6ccb1-b0da-4512-8301-70608bdcb301 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.146807 Sep 05 15:00:01.015699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1489/3117] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:01.305367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:01.306321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:01.312917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:01.313660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:01.314095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.314781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:01.315257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:01.315682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.334286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:01.334923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:01.340713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:01.341196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:01.341628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.342313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:01.342761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:01.343213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.735980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:01.742633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:01.744485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fe4e5dfe-1733-46d3-a1e1-7f12775eeb21 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.442929 Sep 05 15:00:01.745058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1629/3118] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:01.750842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fee1aad4-9a72-47f3-857c-11d2b63cd5dd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.420308 Sep 05 15:00:01.751468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1490/3119] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:01 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:01.779865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:01.780465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:01.786247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:01.786718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:01.787176 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.787844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:01.788289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:01.788728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:01.849990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:01.859286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:01.860754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:01.861891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-70656702-334c-4f83-bb79-5aab63e1db1d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.086295 Sep 05 15:00:01.862495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1630/3120] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:01 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 05 15:00:02.037831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:02.038445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:02.044810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.045399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.045842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.046525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.047005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.047430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.175704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:02.183822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4471a2fa-7179-4499-be8e-9968f7f25a86 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.149885 Sep 05 15:00:02.184375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1491/3121] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:02 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:02.768156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:02.768750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:02.773310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:02.773951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:02.775446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.775930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.776364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.777050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.777504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.777954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.779993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.780468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.780899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.781574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.782023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.782438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.969216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:02.972170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:02.977408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ab7719a7-dbb3-403c-874e-b58f09ea54b7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213186 Sep 05 15:00:02.977981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1631/3122] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:02.980272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-61a17530-ae11-49f0-af60-b052db0fa779 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210820 Sep 05 15:00:02.981338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1492/3123] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:02 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:02.982996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:02.983536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:02.989232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.989711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.990142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:02.990848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:02.991303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:02.991991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:03.052549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:03.061645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:03.063114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:03.064252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9fde7f2e-2acd-44ab-bfd7-9cb238db9200 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.085362 Sep 05 15:00:03.064844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1632/3124] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:03.206217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:03.206845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:03.213186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:03.213654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:03.214081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:03.214759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:03.215726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:03.216143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:03.341484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:03.349623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6b483096-d8b8-4c79-859a-857394d52003 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147708 Sep 05 15:00:03.350215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1493/3125] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:03 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:04.002159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:04.002779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:04.003831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:04.004442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:04.009307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.009798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.010232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.010363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.010718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.010952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.011187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.011407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.011834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.011955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.012307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.012726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.212194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:04.215721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:04.221232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-286b7e12-3d4d-43a3-923f-bd031d9c4852 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223083 Sep 05 15:00:04.221887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1633/3126] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:04.224406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f6588d87-4e56-4daf-b606-08e2bd9e0723 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.224412 Sep 05 15:00:04.225116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1494/3127] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:03 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:04.227334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:04.227941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:04.233675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.234194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.234623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.235352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.235804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.236224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.299884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:04.308411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:04.309884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:04.311057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd38b6ee-3cbb-488a-8037-b7f705138601 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088225 Sep 05 15:00:04.311612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1634/3128] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:04 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:04.373255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:04.373881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:04.379934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.380417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.380845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.381517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:04.381967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:04.382388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:04.506135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:04.514653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-04d41347-267e-416d-9df9-0d7e157b85ae tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.145296 Sep 05 15:00:04.515233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1495/3129] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:04 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:05.245812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:05.246422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:05.247386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:05.248005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:05.253009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.253493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.253927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.254536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.254691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.255048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.255197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.255483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.255601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.256166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.256683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.257040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.444620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:05.452126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:05.453399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c77bc00b-ddc3-48e6-b561-823ba76da9b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211728 Sep 05 15:00:05.454191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1635/3130] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:05.460374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:05.460916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aa024656-b978-4d09-b2d8-09d926e0b509 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217366 Sep 05 15:00:05.461625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1496/3131] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:05 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:05.461764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:05.469242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.469727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.470182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.470882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.471340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.471762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.532711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:05.537590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:05.538197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:05.540073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=96 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:05.541324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:05.542770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:05.543963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a6903a50-2618-478b-8553-6a8606464408 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088301 Sep 05 15:00:05.544619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1636/3132] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:05 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:05.544759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.545093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.545506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.546184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:05.546633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:05.547107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:05.676623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:05.685526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-03c40eee-4076-43e8-bda9-f7a16965a97c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.151775 Sep 05 15:00:05.686082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1497/3133] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:05 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:06.476468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:06.477071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:06.479503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:06.483686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:06.484223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.484368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:06.484698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.485142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.485850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.486296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.486710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.490450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.490939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.491369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.492339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.492756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.493172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.495867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:06.678648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:06.681598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:06.687354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-205f90a6-6453-4ab6-9c07-6cf1384ccaf4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214776 Sep 05 15:00:06.687953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1637/3134] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:06.692427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:06.693031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:06.693185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8020f4f1-0f2b-4be4-b920-7e8c6f2d55b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213196 Sep 05 15:00:06.693862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1498/3135] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:06 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:06.698810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.703356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.703356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.703356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.703356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.703764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.708045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:06.708653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:06.714387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.714899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.715904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.716584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:06.717027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:06.717447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:06.768871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:06.777677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:06.779643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:06.780813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-585d129e-241c-4b84-b079-c1e8dfcdce55 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091955 Sep 05 15:00:06.781400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1638/3136] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:06 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:06.859369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:06.867737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c12182a8-838f-4412-9f1a-60d27984beb4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.163395 Sep 05 15:00:06.868298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1499/3137] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:06 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:07.710807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:07.711433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:07.716292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:07.716904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:07.718445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.718950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.719379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.720056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.720502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.720916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.723475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.723958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.724398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.725178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.725658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.726078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.903946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:07.912261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-978c4e6f-28a7-46e4-9309-b6ae6bda2d1b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.205103 Sep 05 15:00:07.912655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1639/3138] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:07.914676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:07.917140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:07.917726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:07.923763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c20ef73f-5a73-45e5-90cb-b65d9eb60053 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211877 Sep 05 15:00:07.924030 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.924319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1500/3139] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:07 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:07.924488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.924984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.925667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.926117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.926536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.929670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:07.930461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:07.935954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.936439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.936875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.937558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:07.938009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:07.938428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:07.996441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:08.004942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:08.006504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:08.007680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ca1172ac-402b-45d0-88d0-edef388842e9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.094126 Sep 05 15:00:08.008241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1640/3140] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:07 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:08.081805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:08.089985 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83e6bbf0-c040-429a-99bf-7ca1791b62e7 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.164260 Sep 05 15:00:08.091214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1501/3141] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:07 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:08.935298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:08.935910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:08.942309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:08.942831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:08.943248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:08.943929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:08.944380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:08.944800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:08.947634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:08.948274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:08.955020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:08.955499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:08.955931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:08.956618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:08.957065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:08.957484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:09.146293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:09.150389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:09.154570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b02e386e-1d33-4419-8a52-476ba34fd482 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223134 Sep 05 15:00:09.155201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1641/3142] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:09.158584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-aa452efa-b62b-4917-bab1-ece707f21413 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.214704 Sep 05 15:00:09.159275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1502/3143] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:08 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:09.163591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:09.164184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:09.169856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:09.170335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:09.170766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:09.171467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:09.171608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:09.171948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:09.172085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:09.172364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:09.178052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:09.178543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:09.179013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:09.179712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:09.180167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:09.180594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:09.259297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:09.261481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:09.269105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:09.270581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:09.281897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7db210c3-733f-43cc-b328-ae7cd0f5948a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.115654 Sep 05 15:00:09.281897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1642/3144] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:09 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:09.321561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:09.330228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eee3a974-c746-4157-9e35-4e0153c62763 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170044 Sep 05 15:00:09.330801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1503/3145] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:09 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:10.177524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:10.178140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:10.181172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:10.181786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:10.184825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.185307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.185738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.186420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.186901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.187324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.188641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.189120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.189680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.190230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.190678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.192384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.380617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:10.383441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:10.389348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9e111f76-2129-4b14-bd06-ea4d1e8b1052 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216016 Sep 05 15:00:10.389922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1643/3146] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:10.392612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ee08c4c4-b6a3-482a-b2e3-d3f34740e8af tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215186 Sep 05 15:00:10.393283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1504/3147] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:10 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:10.394466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:10.395095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:10.398344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:10.398590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:10.401740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.402482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.403625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.404531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.404907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.405399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.405546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.405834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.406352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.406511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:10.407001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:10.407429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:10.495226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:10.503808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:10.505234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:10.506371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f63b30fb-3743-44b5-9101-4132e5cbb87f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.115545 Sep 05 15:00:10.506949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1644/3148] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:10 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:10.559737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:10.567749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d043b063-425a-4202-8346-1a54a7558a99 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.173495 Sep 05 15:00:10.568303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1505/3149] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:10 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:11.415122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:11.415642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:11.415929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:11.416563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:11.422670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.423189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.423508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.423657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.423980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.424282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.424396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.424733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.425078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.425229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.425523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.425957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.616716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:11.620002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:11.625226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-90c38b2d-9248-4fe7-a3cf-f0ea059b61dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214036 Sep 05 15:00:11.625803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1645/3150] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:11.628129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ea72bc01-e800-4b1d-bcf9-0779f3a739b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215932 Sep 05 15:00:11.628842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1506/3151] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:11 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:11.631038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:11.631644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:11.633102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:11.633703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:11.637482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.637977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.638394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.639108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.639517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.639650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.639966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.640079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.640519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.641211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:11.641667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:11.642097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:11.723366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:11.731962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:11.733409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:11.734556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ad9cbaf1-738f-4e23-a54b-243c6b8715cb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.107849 Sep 05 15:00:11.735163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1646/3152] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:11 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:11.794432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:11.802571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-615ee193-323f-4649-ac44-48fe5f2b7b40 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172959 Sep 05 15:00:11.803351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1507/3153] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:11 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:12.656099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:12.656836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:12.663193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.663720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.664153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.664813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:12.665259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.665259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.665460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:12.665679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.672414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.672887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.673324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.674107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.674457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.674910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.856311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:12.860353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:12.864416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d6ce05c7-2203-42ad-99fa-c5b5284315cb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212322 Sep 05 15:00:12.864980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1647/3154] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:12.869046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8fea03e7-d7e9-41f6-8878-c423cf272d2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.208100 Sep 05 15:00:12.878991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1508/3155] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:12 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:12.879199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:12.879199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:12.879403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:12.879403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:12.879582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.879582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.879582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.879582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.879943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.879943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.880456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.880943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.881377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.882061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:12.882514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:12.882962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:12.970145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:12.978656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:12.980109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:12.981915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ab8b7e89-ca1d-4e01-ab76-a0a7fad22913 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.116028 Sep 05 15:00:12.982463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1648/3156] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:12 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:13.033498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:13.041708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e7e7e31d-11fb-4975-9514-c6a764aae99c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171195 Sep 05 15:00:13.042265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1509/3157] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:12 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:13.887542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:13.888156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:13.893696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:13.894321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:13.894647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:13.895163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:13.895598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:13.896284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:13.896739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:13.897161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:13.900302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:13.900771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:13.901195 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:13.901886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:13.902361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:13.902818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:14.089417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:14.093646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:14.097947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1d565a38-f6f5-4bc0-9e83-cc16fb90c821 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214820 Sep 05 15:00:14.098519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1649/3158] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:14.101928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53916985-02a3-42a1-a98d-41f3ded42516 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.212043 Sep 05 15:00:14.102621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1510/3159] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:13 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:14.107267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:14.107860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:14.113464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:14.113937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:14.114500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:14.115292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:14.115793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:14.116289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:14.118344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:14.119204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:14.125739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:14.126221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:14.126648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:14.127404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:14.127863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:14.128276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:14.216266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:14.224988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:14.226523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:14.227787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a336e0f-f9cd-432d-861a-45d0870662e8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.128333 Sep 05 15:00:14.228342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1650/3160] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:14 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:14.272271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:14.280502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-105fdb8a-dfeb-4679-8e12-cc372dbbc0fa tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.177116 Sep 05 15:00:14.281047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1511/3161] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:14 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:15.122424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:15.123056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:15.125649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:15.126260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:15.129580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.130055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.130483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.131320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.131634 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.132054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.132989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.133460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.133891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.134569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.135056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.135484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.324933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:15.328133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:15.333559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1e5081bf-4b29-4339-8ae7-4a89928b82e0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215456 Sep 05 15:00:15.334172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1651/3162] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:15.336432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7c6a4865-35fa-4d58-b71a-3d58b52cd50a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215090 Sep 05 15:00:15.343702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1512/3163] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:15 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:15.343907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:15.343907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:15.344109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:15.344109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:15.345152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.345573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.346525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.347007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.347454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.347865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.350453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.350971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.351409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.352100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:15.352551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:15.352974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:15.432585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:15.441583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:15.443075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:15.444200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-52dda9db-d7c4-465e-9005-409e4da2d947 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.109128 Sep 05 15:00:15.444991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1652/3164] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:15 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:15.499194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:15.507329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6b349e02-b05d-45f3-b5cb-19fcf5b11fdf tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.169427 Sep 05 15:00:15.507890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1513/3165] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:15 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:16.357520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:16.358057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:16.360054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:16.360769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:16.364216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.364688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.365119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.365800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.366249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.366666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.366901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.367633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.368063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.368737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.369184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.369605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.557499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:16.561867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:16.564132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:16.566438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-103c089c-9475-42e1-ac83-4aba3c7a1d5d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213349 Sep 05 15:00:16.567029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1653/3166] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:16.570956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1d82722f-247e-4b86-91f5-0eafa24c8ad7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215034 Sep 05 15:00:16.571648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1514/3167] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:16 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:16.571790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:16.572361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:16.576004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:16.576648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:16.581943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.581943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.581943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.581943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.582342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.582342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.582535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.582979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.583210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.583867 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:16.585661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:16.585661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:16.667521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:16.676817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:16.678257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:16.679408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0f4f699-d228-4f73-a198-3c399c473b28 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.111478 Sep 05 15:00:16.679956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1654/3168] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:16 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:16.734311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:16.742590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8fc23a91-1423-4171-a4a4-588d7b838344 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.169856 Sep 05 15:00:16.743185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1515/3169] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:16 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:17.594026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:17.594689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:17.601192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.601670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.602103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.602815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.603260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.603680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.604175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:17.604842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:17.611998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.612485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.612927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.613617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.614071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.614493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.794910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:17.801399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:17.803087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fdd92ac1-d739-4fc2-814d-8aaa056e736d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213449 Sep 05 15:00:17.803917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1655/3170] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:17 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:17.808514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:17.809181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:17.809856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4b95d025-d2ba-4809-9c0c-1f0ba58f4a8f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209769 Sep 05 15:00:17.810557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1516/3171] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:17 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:17.815459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.815937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.816366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.817053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.817498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.817913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.826833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:17.827424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:17.833149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.833626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.834054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.834728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:17.835207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:17.835625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:17.883495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:17.892656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:17.894108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:17.895301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3553d93c-37e4-40d3-b619-15fb24f8f983 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090471 Sep 05 15:00:17.895858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1656/3172] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:17 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:17.975387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:17.983959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0d80402b-cea7-4efe-990c-8536230b7c63 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.161363 Sep 05 15:00:17.984554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1517/3173] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:17 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:18.827399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:18.828126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:18.833682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:18.834315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:18.834578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:18.835097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:18.835527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:18.836222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:18.836680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:18.837108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:18.840554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:18.841020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:18.841445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:18.842118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:18.842567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:18.843011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:19.029551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:19.032378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:19.037682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0d1389e-7ce3-42d6-883d-c0ae420bd9b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.207907 Sep 05 15:00:19.038248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1518/3174] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:18 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:19.040622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7659a368-e9ca-4cfb-951b-f1e7fd59368b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217773 Sep 05 15:00:19.055798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1657/3175] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:19.055997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:19.055997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:19.056219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:19.056219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:19.056405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:19.056405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:19.056405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:19.056405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:19.056761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:19.056761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:19.056933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:19.056933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:19.056933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:19.056933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:19.057294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:19.057294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:19.140289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:19.148709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:19.150140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:19.151297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-55743f8f-693a-4d59-be84-4d561e47910f tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.112149 Sep 05 15:00:19.151845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1519/3176] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:19 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:19.207614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:19.215893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-11904277-4234-41f4-8ee3-d6916fabdfcd tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.173509 Sep 05 15:00:19.216456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1658/3177] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:19 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:20.060458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:20.061127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:20.062604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:20.063246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:20.067590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.068066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.068500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.069178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.069582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.069705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.070029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.070139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.070488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.071200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.071657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.072080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.087658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:20.260927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:20.265340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:20.269947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5a210a00-ffd2-444e-b8f8-17e23d629dd6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213282 Sep 05 15:00:20.270600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1520/3178] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:20 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:20.273663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e9cfb843-4416-485b-a10f-99c03cbca0dd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214801 Sep 05 15:00:20.286147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1659/3179] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:20.286347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:20.286347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:20.286554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:20.286554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:20.286747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.286747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.286747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.286747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.287173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.287173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.287350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.287350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.287350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.287879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:20.289622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:20.289622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:20.352915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:20.361459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:20.362962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:20.364106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-53b51000-0cfe-454c-8837-4d9b3237b450 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092570 Sep 05 15:00:20.364905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1521/3180] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:20 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:20.437436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:20.445511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9c225374-8d6f-47fa-96fb-b5479f4f3b48 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170303 Sep 05 15:00:20.446076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1660/3181] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:20 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:21.294097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:21.294712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:21.297853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:21.298464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:21.301369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.301716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.302164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.302878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.303341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.303765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.304795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.305268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.305698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.306378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.306851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.307274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.491135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:21.498381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:21.499732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6db921d3-3299-4bae-9b23-54a7d08c46d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210050 Sep 05 15:00:21.500313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1522/3182] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:21 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:21.504951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:21.505560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:21.507089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e290c601-f2b4-406c-b213-92afc209ed04 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213052 Sep 05 15:00:21.507795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1661/3183] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:21.512530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:21.512704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.513018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.513153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:21.513450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.514167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.514619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.515104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.518663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.519175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.519609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.520291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:21.520740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:21.521157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:21.585815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:21.594870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:21.596303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:21.597429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3c1b9dcd-6f08-4341-a910-6b2b7d0231f2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.096202 Sep 05 15:00:21.597983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1523/3184] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:21 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:21.667965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:21.675990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1cdb0359-f8a3-411c-bda4-0a4b01bd8671 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.167429 Sep 05 15:00:21.676553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1662/3185] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:21 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:22.533139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:22.533787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:22.533970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:22.534578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:22.540326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.540803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.540926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.541242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.541374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.541707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.541935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.542387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.542524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.542825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.543449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.543765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.738310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:22.741278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:22.746758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-186771c9-3609-4afe-b670-62dce7ce8681 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217684 Sep 05 15:00:22.747345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1524/3186] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:22.750117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9357df4c-9623-4077-b721-c571e9378cff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219862 Sep 05 15:00:22.751112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1663/3187] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:22 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:22.751768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:22.752366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:22.755453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:22.756061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:22.758030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.758503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.758956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.759629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.760072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.760490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.762389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.762913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.763357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.764085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:22.765683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:22.765683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:22.850525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:22.859832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:22.861514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:22.862754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-200df630-6def-4d46-aac9-92f08c40cdba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.114499 Sep 05 15:00:22.863419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1525/3188] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:22 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:22.916554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:22.925207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-31ebd576-f903-49a1-bfd2-a457c91a8c7e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.173366 Sep 05 15:00:22.925768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1664/3189] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:22 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:23.775385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:23.776009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:23.781840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:23.782490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:23.783069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:23.783549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:23.783979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:23.784663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:23.785114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:23.785529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:23.788766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:23.789315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:23.789755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:23.790440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:23.790989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:23.791417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:23.969419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:23.977511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d41a9f6-2988-49b5-8bb5-ac94bf11e196 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.206028 Sep 05 15:00:23.982933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1526/3190] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:23 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:23.985143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:23.987879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:23.988736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:23.993596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-004cc68b-883a-41f5-8496-8335a5e9e222 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216143 Sep 05 15:00:23.994163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1665/3191] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:23 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:23.995094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:23.995675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:23.996276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:23.997055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:23.997604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:23.998131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:23.998497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:23.999131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:24.004677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:24.005166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:24.005597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:24.006280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:24.006732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:24.007186 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:24.067321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:24.081738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:24.083212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:24.084367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dc8cf58f-56ce-4499-89f6-9881413b60f5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.100338 Sep 05 15:00:24.084927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1527/3192] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:23 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:24.151853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:24.160190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6df42974-10e2-4dbe-94f9-19db5657955a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.165106 Sep 05 15:00:24.160757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1666/3193] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:23 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:25.000863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:25.001475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:25.007896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.008372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.008802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.009477 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.009967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.010390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.016161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:25.016767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:25.023038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.023516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.023948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.024626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.025078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.025497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.419850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:25.428878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8945b4c0-92e4-4a92-a03e-22098d21eb8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.431941 Sep 05 15:00:25.429450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1528/3194] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:25.433856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:25.434288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:25.434444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:25.440237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.440942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.441372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.442054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.442496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.443179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.443819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf6590cc-dfab-4163-9524-8008f9fac371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.431320 Sep 05 15:00:25.444467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1667/3195] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:25 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:25.448908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:25.450025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:25.455834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.456316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.456747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.457429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:25.457880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:25.458752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:25.514427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:25.523077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:25.524500 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:25.525636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7d8f8e8c-afee-492e-a320-5aa50f6425bc tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095281 Sep 05 15:00:25.526196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1529/3196] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:25 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:25.602309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:25.610519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d79b23df-1f3f-4b84-b39b-55982d3955c1 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.165070 Sep 05 15:00:25.611055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1668/3197] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:25 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:26.451996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:26.452565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:26.459141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.459625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.460090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.460782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.461236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.461873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.467251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:26.467985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:26.474258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.474736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.475194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.475871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.476323 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.476738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.641110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:26.649106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6cf84cfa-ec73-4a05-9c62-1ba47f152b19 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.201073 Sep 05 15:00:26.649662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1530/3198] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:26.663247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:26.666559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:26.667201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:26.671946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2e4fec89-9a9a-4606-8d45-495e5a9aa064 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209003 Sep 05 15:00:26.672515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1669/3199] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:26 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:26.673813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.674292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.674721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.675433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.675880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.676294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.676995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:26.677824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:26.683511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.684003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.684434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.685101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:26.685830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:26.686334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:26.691033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:26.759882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:26.768833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:26.770314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:26.771491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4bc3c884-b3ce-4b1c-b8cf-98b8485fe248 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.120922 Sep 05 15:00:26.772048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1531/3200] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:26 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:26.826860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:26.834933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b52c40fc-6de1-45e5-8817-7e3f23915b74 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.161471 Sep 05 15:00:26.835492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1670/3201] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:26 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:27.673595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:27.674211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:27.681123 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.681598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.682032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.682754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.683235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.683657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.694638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:27.695286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:27.701741 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.702222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.702653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.703361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.703811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.704232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.881619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:27.884699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:27.890274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1eb2e910-00aa-4bc3-b984-e45bad64d51a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.220671 Sep 05 15:00:27.890958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1532/3202] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:27.893038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3b95b03c-eacf-4e8e-b7f3-3cee164469d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.202259 Sep 05 15:00:27.893979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1671/3203] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:27 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:27.896832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:27.898002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:27.898771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:27.899488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:27.906142 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.906972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.907602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.907768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.908406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.908537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.908979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.909210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.909393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.910526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:27.911646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:27.912079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:27.997737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:28.006368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:28.007838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:28.008977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-29c9be23-1ade-4bab-a4ff-d52324cb2eed tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.117039 Sep 05 15:00:28.009543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1533/3204] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:27 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:28.062223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:28.070451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a020b15a-a226-452c-a9a0-d2a0ca0c5005 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.175331 Sep 05 15:00:28.071054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1672/3205] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:27 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:28.914735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:28.915379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:28.916433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:28.917081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:28.922073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:28.922585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:28.923052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:28.923742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:28.923971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:28.924197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:28.924446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:28.924622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:28.924900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:28.925565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:28.926014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:28.926437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:29.119495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:29.124098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:29.128432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1f9a6f19-c021-4f8a-9b08-64149b6b261b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217568 Sep 05 15:00:29.129005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1534/3206] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:29.132106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07239079-4921-44a3-8abb-e61e8879407d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219441 Sep 05 15:00:29.132787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1673/3207] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:28 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:29.135931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:29.136640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:29.138992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:29.139803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:29.142643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:29.143240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:29.143770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:29.144546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:29.145079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:29.145501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:29.147219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:29.147709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:29.148235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:29.148928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:29.149388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:29.149814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:29.229022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:29.237951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:29.239424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:29.240556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d8c6249a-8447-44d6-9974-ef5866a33a24 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.110649 Sep 05 15:00:29.241115 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1535/3208] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:29 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:29.296577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:29.304799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b112fde0-5e43-4e98-a8eb-ff4be0081fec tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170393 Sep 05 15:00:29.305361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1674/3209] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:29 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:30.152039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:30.153155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:30.154993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:30.155638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:30.159700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.160180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.160613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.161296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.161745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.161927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.162165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.162402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.162859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.163542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.163988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.164413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.354558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:30.359281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:30.363761 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e7c9891d-4948-4576-9137-dc24efb66fd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215583 Sep 05 15:00:30.364325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1536/3210] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:30.367682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4d7d0094-27f6-436e-a0ad-ade0973b37dc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216767 Sep 05 15:00:30.372303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1675/3211] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:30 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:30.372480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:30.372480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:30.373420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:30.374035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:30.377400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.378101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.378694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.379706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.379989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.380150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.380470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.380597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.380903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.381583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:30.382155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:30.382577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:30.386567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:30.467830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:30.476297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:30.477733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:30.478906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-72f61333-d53e-49f6-a8a2-f53bf4f8bb98 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.113645 Sep 05 15:00:30.479465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1537/3212] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:30 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:30.533703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:30.541756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7a06b71c-62b9-4580-b2df-dc482b7133ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172608 Sep 05 15:00:30.542314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1676/3213] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:30 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:31.388415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:31.388968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:31.393268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:31.394099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:31.395870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.396040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.396469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.397162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.397616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.398036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.400657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.401148 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.401631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.402324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.402804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.403282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.591732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:31.597250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:31.601585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-103c0fa1-777d-4f19-b2d6-69e0f2f1f84c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218468 Sep 05 15:00:31.602163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1538/3214] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:31.605511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b2f27f9-6f64-41da-9212-cf4049341ced tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.218094 Sep 05 15:00:31.606238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1677/3215] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:31 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:31.606653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:31.607291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:31.610509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:31.611086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:31.613687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.613993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.614433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.615225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.615617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.616040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.616582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.617056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.617742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.618416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:31.618889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:31.619306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:31.707729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:31.716517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:31.718001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:31.719183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2380236b-c4c6-4e0a-818d-e3783e3f6c21 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.116064 Sep 05 15:00:31.719739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1539/3216] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:31 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:31.770285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:31.778370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4711ca0e-fcd4-464f-ba57-186da7c45c20 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171402 Sep 05 15:00:31.778953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1678/3217] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:31 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:32.634502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:32.635239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:32.636010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:32.636608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:32.642199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.642680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.643149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.643591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.643837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.644067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.644294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.644495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.644767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.646338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.646821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.647240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.842025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:32.845352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:32.850571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ada75605-bacb-413e-a4fe-2301fc5747b5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220003 Sep 05 15:00:32.851289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1540/3218] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:32 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:32.853618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b087586-8c6d-4687-97c6-aafa09547eb0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.221414 Sep 05 15:00:32.854177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1679/3219] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:32.856023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:32.856626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:32.862574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.863503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.863931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.864624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.865075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.865499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.866747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:32.870113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:32.875960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.876444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.876877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.877568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:32.878022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:32.878442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:32.939422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:32.948018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:32.949490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:32.951159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c867242b-1d23-4283-ad77-bf333293cc88 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.098917 Sep 05 15:00:32.951711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1541/3220] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:32 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:33.020316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:33.029018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1aa7ecb3-7a6a-4169-b3dc-d735d495c881 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.173064 Sep 05 15:00:33.029581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1680/3221] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:32 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:33.877933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:33.878603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:33.879017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:33.879132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:33.885037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:33.885208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:33.885515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:33.885642 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:33.885944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:33.886067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:33.886624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:33.886742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:33.887117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:33.887253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:33.887597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:33.888315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:34.073817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:34.082759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ae820b29-215f-4c3a-afa6-90bad0b99e07 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.208645 Sep 05 15:00:34.083803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1681/3222] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:34.085984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:34.088302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:34.088895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:34.094872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:34.095356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:34.095783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:34.096468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:34.097311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:34.097311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:34.100177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-073dc394-2ed4-4976-95cb-aa0d185df1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.226048 Sep 05 15:00:34.101097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1542/3223] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:33 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:34.109431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:34.110127 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:34.119297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:34.119777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:34.120207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:34.120896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:34.121351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:34.121769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:34.163734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:34.173794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:34.175270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:34.176488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0f390ce6-cfe6-4866-867b-549d51031cb5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091692 Sep 05 15:00:34.177123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1682/3224] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:34 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:34.261093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:34.269213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4d80342f-c1d7-4b3a-9d22-c594da29b596 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.163695 Sep 05 15:00:34.269777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1543/3225] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:34 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:35.105504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:35.106112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:35.112529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.113009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.113443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.114127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.114579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.115038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.123264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:35.123899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:35.130265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.130743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.131205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.131890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.132336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.132757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.311131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:35.315043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:35.319425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4787fc8b-14b5-4229-82b0-cf655b720983 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217767 Sep 05 15:00:35.319998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1683/3226] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:35.334163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5df40de4-4654-4d56-b479-b68da498d988 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.204000 Sep 05 15:00:35.334163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1544/3227] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:35.334451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:35.334451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:35.334671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:35.334671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:35.334873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.334873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.334873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.334873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.335247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.335247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.335812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.336293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.336813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.337410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:35.337864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:35.338819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:35.422608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:35.431212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:35.432763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:35.434057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ded02eb4-af99-430b-b11c-f7bf08201ab5 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.113124 Sep 05 15:00:35.435192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1684/3228] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:35 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:35.488295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:35.497664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-518ec115-f0fa-47db-8d72-74a3ff62e3ce tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171870 Sep 05 15:00:35.498230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1545/3229] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:35 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:36.350191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:36.350191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:36.356877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.357654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.358565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.359480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:36.360012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.360132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:36.360790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.361408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.363770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=98 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:36.367168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.368191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.368866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.369647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.370155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.370639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.640953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:36.649108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9cae847c-a45c-4f94-bafe-b6f314041e8f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.304592 Sep 05 15:00:36.649683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1685/3230] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:36.658985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:36.658985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:36.658985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=98 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:36.665180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.665180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.665180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.665180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.665627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.665627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.674322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:36.684580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-139522e7-3d4a-4e7e-a079-6592584307fa tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.329610 Sep 05 15:00:36.685898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1546/3231] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:36.691426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:36.692035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:36.698561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.699212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.699705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.700948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:36.701413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:36.701862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:36.778918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:36.787608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:36.789037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:36.790193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5e4cbac7-eb30-4b81-bca1-b2058ab48742 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.139606 Sep 05 15:00:36.790751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1686/3232] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:36 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:36.930586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:36.939351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-10877f43-2b3d-4ad6-93d5-f1c52546607d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.251940 Sep 05 15:00:36.939920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1547/3233] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:36 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:37.674485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:37.675276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:37.681707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.682181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.682611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.683324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.683771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.684190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.708661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:37.709302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:37.716598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.717144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.717573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.718257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.718707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.719179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.721793 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:37.865624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:37.874061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7e6069ee-77e9-490f-abd6-4a50f3cb06d8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.203418 Sep 05 15:00:37.874878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1687/3234] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:37.879228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:37.879827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:37.885548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.885898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.886332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.887046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.888004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.888426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.889301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:37.897569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7ad4f367-1913-4646-8ab3-a9e691f1f935 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.192798 Sep 05 15:00:37.898152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1548/3235] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:37 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:37.953178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:37.961937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:37.963241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:37.963412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:37.963881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:37.964536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-089fcae3-b46f-4280-a4c3-688ee10c25a9 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.088987 Sep 05 15:00:37.965091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1688/3236] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:37 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:37.970517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.971034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.971465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:37.972141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:37.972585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:37.973001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:38.099047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:38.107403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-47cb64b5-8f99-4b14-8e0e-26e0c1fb9f60 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.147967 Sep 05 15:00:38.107998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1549/3237] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:37 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:38.897519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:38.898122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:38.904534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:38.905005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:38.905429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:38.906097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:38.906541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:38.906990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:38.921640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:38.922369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:38.928658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:38.929134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:38.929563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:38.930250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:38.930698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:38.931147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:39.107101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:39.108400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:39.113001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-59b45def-c1e1-4558-8498-1ef073078f02 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219368 Sep 05 15:00:39.113576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1689/3238] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:39.116816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b37caa73-f274-4191-8bb5-df421015c5ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.199757 Sep 05 15:00:39.117857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1550/3239] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:38 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:39.121190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:39.121883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:39.127952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:39.128467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:39.128902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:39.129581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:39.130026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:39.130442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:39.136136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:39.136740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:39.142609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:39.143119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:39.143554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:39.144238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:39.144683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:39.145101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:39.193586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:39.202297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:39.203748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:39.204880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c1290034-340d-44b3-9395-49c40f723139 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.090408 Sep 05 15:00:39.205449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1690/3240] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:39 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:39.290008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:39.298857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5035d57f-8af1-4bae-a8a6-29f875cb719e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170517 Sep 05 15:00:39.299419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1551/3241] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:39 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:40.139531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:40.140072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:40.140441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:40.140579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:40.146550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.146716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.147065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.147502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.147661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.148101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.148210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.148620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.148782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.149042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.149229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.149646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.333618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:40.341896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-18f2a01d-e089-481e-aff5-011ccd47ed15 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.206919 Sep 05 15:00:40.342740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1691/3242] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:40.345212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:40.347215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:40.347751 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:40.353462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.353977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.354409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.354713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1f21b685-9ada-40c7-838c-3e2f7e5a578d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219451 Sep 05 15:00:40.355120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.357943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.358117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1552/3243] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:40.358234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.361116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:40.361831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:40.367648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.368197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.368715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.369462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:40.370103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:40.370593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:40.423620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:40.425774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:40.433263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:40.436590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:40.436590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-34685a8e-266e-4069-8e2d-3160fd74d067 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.092961 Sep 05 15:00:40.437263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1692/3244] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:40 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:40.517874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:40.526030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-167e1b9f-9f6b-4128-813e-15e1fc144efe tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.169333 Sep 05 15:00:40.526594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1553/3245] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:40 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:41.365477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:41.366173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:41.373416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.373898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.374332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.375050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.375500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.375925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.378432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:41.379066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:41.385316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.385789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.386226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.386928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.387375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.387795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.570091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:41.573203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:41.578552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-39dedb53-dc71-4dba-8695-7061b617ac4b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216964 Sep 05 15:00:41.579159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1693/3246] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:41.581668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3f41022d-96b1-4366-9dd0-9c1a157128c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.206944 Sep 05 15:00:41.582575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1554/3247] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:41 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:41.583737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:41.584343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:41.591930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:41.592536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:41.595748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.596268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.596701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.597420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.597877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.598293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.598406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.598865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.599298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.599978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:41.600431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:41.600849 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:41.684536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:41.692995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:41.694426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:41.695588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-895a5942-a3ab-4c31-861a-ea89544e047d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.115517 Sep 05 15:00:41.696147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1694/3248] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:41 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:41.751007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:41.759140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-030e71ba-38b5-4a36-be48-58422717f04d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171232 Sep 05 15:00:41.759700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1555/3249] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:41 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:42.601618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:42.602342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:42.609032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:42.609032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:42.609713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.610199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.610631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.611354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.611800 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.612215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.613040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.613528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.613979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.614655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.615134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.615555 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.804726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:42.808705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:42.813532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-219f3d37-91b1-4fe9-8319-077df087af8c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215870 Sep 05 15:00:42.814103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1695/3250] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:42.817884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e165f712-3de2-491e-8b7d-6783a32dcf74 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216326 Sep 05 15:00:42.818584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1556/3251] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:42 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:42.823335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:42.823936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:42.830386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.830903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.831347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.832035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.832488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.832910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.833541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:42.834150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:42.839970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.840450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.840937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.841613 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:42.842064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:42.842484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:42.917032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:42.926101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:42.927568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:42.928712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e3bded11-10c7-4c88-923c-345fc35bde8c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.113707 Sep 05 15:00:42.929269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1696/3252] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:42 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:42.980892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:42.989621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ed0ee1b-80b6-411f-a6a6-6343fab5586e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170082 Sep 05 15:00:42.990178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1557/3253] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:42 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:43.837122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:43.837729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:43.841623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:43.842233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:43.844876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:43.845357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:43.845786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:43.846471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:43.846960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:43.847415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:43.848191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:43.848660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:43.849085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:43.849758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:43.850202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:43.850618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:44.038644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:44.041769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:44.047467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7dacf628-1a8c-4d14-ad1d-42e0ebe76f58 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214336 Sep 05 15:00:44.048242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1697/3254] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:44.050545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-54258b33-5fa8-4cc4-b43e-f3c1c8740335 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213360 Sep 05 15:00:44.052706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:44.053006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:44.058577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:44.059095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:44.060120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:44.060804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:44.061251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:44.061670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:44.063175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1558/3255] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:43 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:44.067814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:44.068424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:44.074176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:44.074663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:44.075133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:44.075825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:44.076283 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:44.076956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:44.128479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:44.137326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:44.138807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:44.139968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4da0cc74-b4e5-4102-80e3-aef3aff2d048 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.091039 Sep 05 15:00:44.140532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1698/3256] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:44 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:44.221388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:44.229675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6225dc66-f1d1-4cb6-b422-12c601ee3ac4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.165505 Sep 05 15:00:44.230238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1559/3257] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:44 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:45.071372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:45.071982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:45.075465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:45.075885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:45.078586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.079102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.079533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.080230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.080686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.081108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.082152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.082635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.083103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.083787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.084238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.084656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.277021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:45.279821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:45.285282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4fef4ddd-b20a-458e-9e85-22fdd2c84f22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217757 Sep 05 15:00:45.285846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1699/3258] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:45.288108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4edc638-50c6-45c5-8377-7f999f56d8f7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216652 Sep 05 15:00:45.302740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1560/3259] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:45 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:45.303045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:45.303045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:45.303254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:45.303254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:45.303443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.303443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.303443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.303443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.303812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.303812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.303982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.303982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.303982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.303982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:45.304466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:45.304466 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:45.368880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:45.377808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:45.379274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:45.380414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a37be17b-cdbf-45a9-b60e-8683daa5acd7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093663 Sep 05 15:00:45.380970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1700/3260] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:45 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:45.454418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:45.462475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-837fe26a-3de7-43e7-a324-2bc18c861239 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172908 Sep 05 15:00:45.463062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1561/3261] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:45 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:46.308604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:46.309258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:46.310839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:46.311448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:46.315178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.315658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.316101 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.316782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.317233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.317655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.317780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.318183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.318617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.319338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.319785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.320206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.735126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:46.738016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:46.743789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ececc89-6b7d-4e19-b5c4-1695ecf78c9b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.439314 Sep 05 15:00:46.744360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1701/3262] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:46.746824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22f58d61-5c09-43b5-b954-afb7e89bf0d9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.439854 Sep 05 15:00:46.762138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1562/3263] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:46.762376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:46.762376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:46.762655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:46.762655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:46.763428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.763428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.763428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.763428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.763834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.763834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.764042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.764042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.764042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.764042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:46.764449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:46.764449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:46.829468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:46.838114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:46.839579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:46.841247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-71611beb-bb9c-4691-b153-2c0fdfd2b692 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095439 Sep 05 15:00:46.841815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1702/3264] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:46 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:46.911034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:46.919234 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b37cf773-ebb0-4c6d-a373-5a2c0b9dc491 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.170391 Sep 05 15:00:46.919800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1563/3265] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:46 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:47.767764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:47.768435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:47.771404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:47.772016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:47.775056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:47.775542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:47.775983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:47.776679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:47.777138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:47.777558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:47.777988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:47.779166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:47.779594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:47.780271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:47.780906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:47.781329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:47.968262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:47.975148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:47.976493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b78b6a89-f6f7-474a-ac0d-e2e0558aa889 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212688 Sep 05 15:00:47.977294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1703/3266] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:47.977501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:47.981784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:47.982630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:47.984516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1feace18-d8f6-47d2-9557-6ccde672b7b8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216767 Sep 05 15:00:47.985171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1564/3267] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:47 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:47.990011 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:47.990615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:47.996602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:47.997117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:47.997550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:47.998249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:47.998688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:47.999308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:48.001089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:48.001688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:48.002135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:48.002870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:48.003330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:48.003795 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:48.091532 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:48.100360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:48.101835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:48.103077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1ac6b671-53ea-4397-8c2d-377f90e6c857 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.124769 Sep 05 15:00:48.103545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1704/3268] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:47 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:48.153148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:48.161657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fa7583e3-94f3-4b88-82bf-3a5dfe66d7b2 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.175521 Sep 05 15:00:48.162221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1565/3269] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:47 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:49.000417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:49.001025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:49.007559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.008045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.008480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.008781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:49.009190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.009526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:49.009638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.010003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.016065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.016539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.016969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.017650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.018093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.018509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.202251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:49.209168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:49.210421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-145e3dac-a65c-4f3b-b7f3-49e7e0dc6ad0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213943 Sep 05 15:00:49.211024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1705/3270] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:49.213716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-338f07a7-a41c-4238-8941-2841a08b2dfd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.208751 Sep 05 15:00:49.214253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1566/3271] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:49.216436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:49.217230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:49.219955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:49.220713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:49.223875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.224359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.224786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.225658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.226106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.226524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.231598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.232158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.232681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.233607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:49.234126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:49.234610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:49.296366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:49.304803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:49.306222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:49.307381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0791824d-03a8-41f1-bf28-c4ee975cb6b7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.095464 Sep 05 15:00:49.307931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1706/3272] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:49 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:49.378396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:49.386644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ea5d4d33-1e85-4513-afcb-7b007b4bd672 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.171226 Sep 05 15:00:49.387248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1567/3273] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:49 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:50.234561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:50.235216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:50.237128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:50.237744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:50.241824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.242314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.243035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.243728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.244099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.244222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.244577 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.244697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.245010 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.245690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.246139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.246561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.471030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:50.475612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:50.479615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ca588140-819f-494f-9874-f65b7b9ba61e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.246147 Sep 05 15:00:50.480184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1568/3274] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:50.484644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-317b1bc5-309d-451a-b08d-9967238fbcf9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.253947 Sep 05 15:00:50.484853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:50.485399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:50.491220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.497671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.497671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.497671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.497671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.498088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.498402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1707/3275] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:50.506951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:50.507564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:50.514144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.514633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.515106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.515806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:50.516263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:50.516688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:50.563687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:50.572456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:50.573874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:50.575632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4700e38d-12fe-465f-989d-e3f47d3e2672 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093918 Sep 05 15:00:50.576210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1569/3276] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:50 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:50.656349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:50.664521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-923ded06-dd71-4652-ab52-d565e38c869c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.165069 Sep 05 15:00:50.665085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1708/3277] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:50 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:51.502949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:51.503583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:51.510347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.510859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.511299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.511987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.512964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.513388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:51.513864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.514151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:51.520577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.521053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.521486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.522167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.522619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.523088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.538561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:51.704376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:51.710961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:51.712734 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ceb2ee3-79ec-4e32-9e4c-d786a1812852 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213663 Sep 05 15:00:51.713407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1570/3278] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:51 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:51.718671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:51.719363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:51.719889 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ca0c915d-a1fa-4987-bfd1-deb3ce2d6a72 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210906 Sep 05 15:00:51.720447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1709/3279] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:51.725140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:51.725301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.725722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.726155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.726394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:51.726876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.727763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.727899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.735397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.738584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.738584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.738584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:51.738584 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:51.739092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:51.797285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:51.805746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:51.807197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:51.808325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-75df7f6c-c296-46d0-9c5a-b8da01f51c94 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093943 Sep 05 15:00:51.808879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1571/3280] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:51 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:51.880189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:51.888971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f398c0ee-453b-4ed7-b774-2bf108603d5a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.167424 Sep 05 15:00:51.889544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1710/3281] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:51 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:52.738194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:52.738817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:52.741892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:52.742536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:52.745516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.745992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.746416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.747136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.747561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.747975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.749208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.749714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.750152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.750865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.751320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.751744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.941135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:52.945051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:52.949222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7b0dec3-317d-4471-acea-dc3545119d87 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.214898 Sep 05 15:00:52.949782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1572/3282] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:52 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:52.954639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:52.955263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:52.961147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.961334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b4737542-af9d-447e-b881-97f294969abf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223183 Sep 05 15:00:52.961623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.962053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.962203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1711/3283] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:52.963218 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.963910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.964550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.967405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:52.967999 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:52.975033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.975588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.976105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:52.976862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:52.977381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:52.977804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:53.039160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:53.047710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:53.049135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:53.050291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-66a87b3c-3da1-4c83-97bf-bc3fd14ff090 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.099112 Sep 05 15:00:53.050857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1573/3284] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:52 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:53.122089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:53.130122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48f2e4ac-bfd3-4261-bfae-dd4a217dec7a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.167055 Sep 05 15:00:53.130679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1712/3285] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:52 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:53.972879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:53.973485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:53.979876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:53.980354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:53.980781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:53.981952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:53.982395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:53.982833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:53.985274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:53.985907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:53.992296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:53.993064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:53.993500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:53.994215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:53.994665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:53.995139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:54.182567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:54.186640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:54.191279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c280b6bd-d478-49ae-8ee0-8ed9dff1d9f2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.222113 Sep 05 15:00:54.191868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1574/3286] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:53 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:54.194993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4983252-6e34-4f26-8c9f-05910447a3bf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213959 Sep 05 15:00:54.195732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1713/3287] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:54.196545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:54.197148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:54.201110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:54.201904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:54.204373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:54.205330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:54.205554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:54.206313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:54.206855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:54.207444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:54.208903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:54.209385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:54.209813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:54.210492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:54.211073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:54.215228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:54.277575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:54.286511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:54.288081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:54.289217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-271f9fc8-0d65-4056-9f41-391b3ec267be tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.096441 Sep 05 15:00:54.289771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1575/3288] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:54 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:54.362722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:54.371090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c476480e-7262-48ae-aee0-697c99c50990 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.174256 Sep 05 15:00:54.371653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1714/3289] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:54 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:55.214366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:55.215113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:55.219113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:55.219736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:55.222067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.222538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.223002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.223681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.224126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.224536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.226093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.226578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.227059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.227763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.228230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.228657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.416413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:55.420543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:55.424657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4215070a-43da-4488-b45f-6727a1e82dc8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.214114 Sep 05 15:00:55.425211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1576/3290] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:55 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:55.428948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-84f8dec8-3407-402c-9d70-c573b075cb84 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214391 Sep 05 15:00:55.429503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1715/3291] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:55.430198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:55.430983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:55.436746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.437411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.437845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.438701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.439186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.439609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.447853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:55.448464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:55.454740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.455256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.455696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.456387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:55.456840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:55.457264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:55.503735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:55.512692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:55.514808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:55.515978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a1ec57e1-48e2-43fc-9b68-7507f648a80d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.089659 Sep 05 15:00:55.516537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1577/3292] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:55 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:55.595097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:55.603471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e014e620-dc7d-4ea9-8a1e-b634d6c729b4 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.173036 Sep 05 15:00:55.604050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1716/3293] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:55 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:56.447642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:56.448197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:56.452166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:56.452777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:56.454592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.455099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.455540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.456247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.456694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.457112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.459108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.459585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.460022 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.460701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.461153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.461576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.650433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:56.655090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:56.659311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-85a007cb-c4b9-4905-bc60-dc5e9f35d930 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215600 Sep 05 15:00:56.659883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1578/3294] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:56 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:56.663762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-76a39e8d-a410-4cbe-ba42-3b53f330fcbd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215397 Sep 05 15:00:56.674912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:56.675136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1717/3295] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:56.675243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:56.675353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:56.675353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:56.675540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.675540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.675540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.675540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.675897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.675897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.676068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.676914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.677362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.678113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:56.678568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:56.679019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:56.743117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:56.751936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:56.753373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:56.754504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ddced1cf-65c9-418f-b743-df5cdfc64dd3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.093719 Sep 05 15:00:56.755101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1579/3296] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:56 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:56.829496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:56.837619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fc3826b8-9bf4-4b8d-a2d3-5770c114db7c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.172329 Sep 05 15:00:56.838195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1718/3297] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:56 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:57.682691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:57.683307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:57.686930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:57.687543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:57.690356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.690859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.691365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.692126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.692569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.692988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.693750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.694227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.694661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.695380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.695832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.696257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.872716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:57.880855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dc1ac724-4992-4c19-a355-bf6bcf8278a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.198453 Sep 05 15:00:57.881420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1719/3298] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:57.902598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:57.911423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4f4169a8-9be1-4f32-84bc-f13c84406b23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.232822 Sep 05 15:00:57.912059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1580/3299] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:57 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:57.933051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:57.933619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:57.939496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.939976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.940409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.941086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.941524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.942049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.967588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:57.968272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:57.974403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.974995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.975496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.976245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:57.976798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:57.977297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:57.993113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:00:58.007927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:58.016077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:58.017521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:58.018670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d1270864-aa57-4c09-82c4-a40f5cfceca1 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.136344 Sep 05 15:00:58.019270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1720/3300] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:57 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:58.105009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:58.113748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b2f98966-683e-477d-acca-5ad94aed219e tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.197405 Sep 05 15:00:58.114310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1581/3301] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:57 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:58.904576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:58.905178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:58.911563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:58.912045 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:58.912473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:58.913147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:58.913593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:58.914009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:58.935995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:58.936598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:58.942942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:58.943416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:58.943847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:58.944523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:58.944967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:58.945387 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:59.096937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:59.105080 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1b710c6-e962-47e0-aaed-f29c56ec3193 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.204968 Sep 05 15:00:59.105639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1721/3302] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:00:59.110085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:59.111070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:59.116514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:59.116989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:59.117418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:59.118352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:59.118818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:59.119245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:59.122823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:59.131194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-93aeec32-4c45-4d20-b52c-53733c719f59 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.198948 Sep 05 15:00:59.132216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1582/3303] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:58 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:00:59.136791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:00:59.137472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:00:59.143895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:59.144450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:59.144945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:59.145700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:00:59.146224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:00:59.146733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:00:59.182028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:59.191099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:59.192542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:59.193699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4555a74-95d2-45e3-9b25-984008a9afba tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.087143 Sep 05 15:00:59.194233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1722/3304] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:00:59 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:00:59.276208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:00:59.284222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-30d13389-9afd-4c7e-b3ea-19839c78a34a tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.150999 Sep 05 15:00:59.284779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1583/3305] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:00:59 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:00.128272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:00.133926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:00.135383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.135878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.136314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.137009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.137463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.137886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.155662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:00.156270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:00.162526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.163030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.163512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.164188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.164631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.165045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.332458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:00.341943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9ec9f0ad-ab1c-4436-adb7-453a92f358b9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216970 Sep 05 15:01:00.342593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1723/3306] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:00.344096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:00.347971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:00.348714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:00.355531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.356280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.357388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.358326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.358927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.359421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.363121 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-46b99d7d-aab3-440c-b0ca-d99478e1558b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211827 Sep 05 15:01:00.363699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1584/3307] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:00 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:00.368403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:00.369040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 6dc3d4fd-7509-404c-af29-824137cd6af4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:00.383431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.384153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.384705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.385488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:00.385971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:00.386399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:00.429811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:00.440856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:00.442388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:00.443820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fef32cac-b02e-4d9b-84c7-ab0907a0cbaa tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 200 len: 1444 microversion: 2.20 time: 0.100185 Sep 05 15:01:00.444454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1724/3308] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:00 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 1444 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:00.470719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-62ca67a7-205e-4922-a3d1-e586c1582989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '.version_select at 0x7fb1914804c0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:00.524698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:00.533487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-95a89315-85b2-4431-8a7b-6112728f01d0 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4" status: 200 len: 1735 microversion: 2.1 time: 0.168861 Sep 05 15:01:00.534051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1585/3309] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:00 2022] GET /compute/v2.1/servers/6dc3d4fd-7509-404c-af29-824137cd6af4 => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:00.545442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-62ca67a7-205e-4922-a3d1-e586c1582989 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966763067" status: 204 len: 0 microversion: 2.20 time: 0.079153 Sep 05 15:01:00.546084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1725/3310] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Sep 5 15:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1966763067 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 05 15:01:00.555498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f59e41f-19c6-46a4-a184-f268e4a0b58d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '.version_select at 0x7fb191584700>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:00.631257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f59e41f-19c6-46a4-a184-f268e4a0b58d tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-233443179" status: 202 len: 0 microversion: 2.1 time: 0.079322 Sep 05 15:01:00.631933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1586/3311] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Sep 5 15:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-233443179 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:01:01.365692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:01.366882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:01.376305 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:01.377325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:01.377883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:01.378756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:01.379394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:01.379968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:01.388495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:01.389105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:01.414547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:01.419979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:01.420432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:01.421130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:01.421579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:01.421997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:01.639511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:01.649498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f784fd60-ac65-4047-8320-4dacba5498f2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.287677 Sep 05 15:01:01.658931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1726/3312] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:01.659439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:01.665863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf0d9649-4dcd-4161-974c-597d17d3196c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'create', calling method: .version_select at 0x7fb191773940>, body: {"keypair": {"name": "tempest-keypair-1453927189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKe99Tvry06ZFK8+B1qXXqkyTja8SpqpWAxEomTkg+o1VQUBxD3bMc0VXeVzn2yGpf//f1m5NOQFMHtFNBAmlj4BIHmc7IRjX7/X5G6IkBlVor2yzOYmNpkLrFUSOmd/bw=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:01:01.672841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fe7b235f-4256-435a-b141-23b1cfc5a32d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.288966 Sep 05 15:01:01.685344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-bf0d9649-4dcd-4161-974c-597d17d3196c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for project 834730ab3cfd4d649fc270843d47b291. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:01:01.685578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1587/3313] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:01 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:01.690866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-bf0d9649-4dcd-4161-974c-597d17d3196c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for user 91c691b6a7724d708bfc7424908516c8 and project 834730ab3cfd4d649fc270843d47b291. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:01:01.753201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-664613ef-885f-4359-a58e-be43e9eebe23 req-8eb81276-c94a-4ba9-bdfd-d8b3c17e9c5d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:01:01.762752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-664613ef-885f-4359-a58e-be43e9eebe23 req-8eb81276-c94a-4ba9-bdfd-d8b3c17e9c5d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:01.763390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-664613ef-885f-4359-a58e-be43e9eebe23 req-8eb81276-c94a-4ba9-bdfd-d8b3c17e9c5d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:01.763703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-664613ef-885f-4359-a58e-be43e9eebe23 req-8eb81276-c94a-4ba9-bdfd-d8b3c17e9c5d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:01.774606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-664613ef-885f-4359-a58e-be43e9eebe23 req-8eb81276-c94a-4ba9-bdfd-d8b3c17e9c5d service nova] Creating event network-changed:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 15:01:01.780522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-664613ef-885f-4359-a58e-be43e9eebe23 req-8eb81276-c94a-4ba9-bdfd-d8b3c17e9c5d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087025 Sep 05 15:01:01.781122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1588/3314] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:01:01.795962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf0d9649-4dcd-4161-974c-597d17d3196c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.135350 Sep 05 15:01:01.796577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1727/3315] 10.222.0.15 () {62 vars in 1200 bytes} [Mon Sep 5 15:01:01 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 137 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 05 15:01:02.675389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:02.676182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:02.682855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:02.683364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:02.683785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:02.684512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:02.685627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:02.686088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:02.697389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:02.698813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:02.705565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:02.706449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:02.706995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:02.707768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:02.708296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:02.708950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:02.715088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:02.903020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:02.911862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b644c31c-cad9-444e-82bc-7326e623b2dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.241363 Sep 05 15:01:02.912614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1589/3316] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:02.919737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:02.941192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9846dfbc-e019-4e23-b3ba-22e8db12bf40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.248288 Sep 05 15:01:02.941769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1728/3317] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:02 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:03.941066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:03.941686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:03.948008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:03.948489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:03.948923 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:03.949605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:03.950055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:03.950518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:03.970829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:03.971709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:03.978626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:03.979229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:03.979783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:03.980548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:03.981009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:03.981457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:04.212706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:04.221671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06d22a5d-0031-43c8-ac31-c364a3911b74 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.284431 Sep 05 15:01:04.222652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1590/3318] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:04.240210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:04.248862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b4057eb7-8e0c-4a37-9fc7-ffbe57fb7b68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.282726 Sep 05 15:01:04.249422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1729/3319] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:03 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:04.334851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-824581528", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b4150a16-af6f-4e15-ada3-1b778d9ea7f0"}], "security_groups": [{"name": "tempest-securitygroup--1632303437"}], "key_name": "tempest-keypair-1453927189", "user_data": "}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:01:04.439333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] validate_networks() for [('b4150a16-af6f-4e15-ada3-1b778d9ea7f0', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 15:01:04.869597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 15:01:04.870018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 15:01:04.870490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 15:01:04.870954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 15:01:04.871369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 15:01:04.880276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:04.880754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:04.881185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:04.881918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:04.882372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:04.882814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:04.899903 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for project 834730ab3cfd4d649fc270843d47b291. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:01:04.902172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=99,nova_api:DELETE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:04.905220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Getting quotas for user 91c691b6a7724d708bfc7424908516c8 and project 834730ab3cfd4d649fc270843d47b291. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:01:04.916017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 15:01:04.918263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 15:01:05.045177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c6d55adb-af56-44fe-a649-92da26a230e7 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.714898 Sep 05 15:01:05.046633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1591/3320] 10.222.0.15 () {62 vars in 1188 bytes} [Mon Sep 5 15:01:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 716 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 05 15:01:05.057128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fddae4e4-f513-4be5-ba12-c06d12bb0e90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:05.057738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fddae4e4-f513-4be5-ba12-c06d12bb0e90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:05.060046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:05.111818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fddae4e4-f513-4be5-ba12-c06d12bb0e90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:05.120132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fddae4e4-f513-4be5-ba12-c06d12bb0e90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:05.121562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fddae4e4-f513-4be5-ba12-c06d12bb0e90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:05.122693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fddae4e4-f513-4be5-ba12-c06d12bb0e90 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1281 microversion: 2.20 time: 0.069535 Sep 05 15:01:05.124633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1730/3321] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:05 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:05.244155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:05.244759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:05.252667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:05.253175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:05.253606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:05.254286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:05.254733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:05.255181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:05.272577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:05.273192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:05.280469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:05.280959 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:05.281401 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:05.282104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:05.282561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:05.283021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:05.455381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:05.458105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:05.463636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6d9e1fd3-265c-4327-9bdf-29a7a878aba4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223557 Sep 05 15:01:05.464265 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1592/3322] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:05.466583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cc57abb8-467b-489b-b6f3-478e096c181e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.197884 Sep 05 15:01:05.467187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1731/3323] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:05 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:06.147786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f7668478-0de1-430c-8845-c89998f34709 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:06.148394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f7668478-0de1-430c-8845-c89998f34709 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:06.201988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f7668478-0de1-430c-8845-c89998f34709 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:06.209554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f7668478-0de1-430c-8845-c89998f34709 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:06.211029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f7668478-0de1-430c-8845-c89998f34709 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:06.212137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f7668478-0de1-430c-8845-c89998f34709 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1281 microversion: 2.20 time: 0.068180 Sep 05 15:01:06.212676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1593/3324] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:06 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:06.486091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:06.486704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:06.489022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:06.489627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:06.493679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:06.494162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:06.494598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:06.495313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:06.495774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:06.495955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:06.496205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:06.496429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:06.497312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:06.497722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:06.498013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:06.498353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:06.687461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:06.694221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:06.695629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-354d30df-8abf-4537-9a13-4ca32690498f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213467 Sep 05 15:01:06.696201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1732/3325] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:06.703071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5566dc6b-fb25-4a38-bd84-20ef3c1d527b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217713 Sep 05 15:01:06.703625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1594/3326] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:06 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:07.239132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-10652c1a-9bcc-4283-aa31-5943598e194b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:07.239858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-10652c1a-9bcc-4283-aa31-5943598e194b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:07.293591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-10652c1a-9bcc-4283-aa31-5943598e194b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:07.301486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-10652c1a-9bcc-4283-aa31-5943598e194b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:07.303047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-10652c1a-9bcc-4283-aa31-5943598e194b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:07.304223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-10652c1a-9bcc-4283-aa31-5943598e194b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1281 microversion: 2.20 time: 0.069494 Sep 05 15:01:07.304860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1733/3327] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:07 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1281 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:07.719463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:07.720057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:07.726068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:07.726683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:07.726858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:07.727193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:07.727625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:07.728304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:07.728772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:07.729190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:07.736274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:07.736789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:07.737225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:07.737944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:07.738399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:07.738839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:07.924422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:07.928189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:07.932743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ec636061-061d-4f9a-a296-6ff27e56d8f7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217217 Sep 05 15:01:07.933353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1595/3328] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:07.937619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e5a63356-3420-4ad6-ac34-597c0fb35bbf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215604 Sep 05 15:01:07.938174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1734/3329] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:07 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:08.330215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dfab985e-460d-4663-906f-bcd77755a394 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:08.330884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dfab985e-460d-4663-906f-bcd77755a394 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:08.383666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfab985e-460d-4663-906f-bcd77755a394 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:08.391706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfab985e-460d-4663-906f-bcd77755a394 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:08.393163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dfab985e-460d-4663-906f-bcd77755a394 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:08.394261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dfab985e-460d-4663-906f-bcd77755a394 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1281 microversion: 2.20 time: 0.068690 Sep 05 15:01:08.394880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1596/3330] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:08 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1281 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:08.956888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:08.957499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:08.960303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:08.960917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:08.963949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:08.964424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:08.964854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:08.965533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:08.966553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:08.967015 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:08.968453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:08.968934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:08.969553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:08.970263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:08.970706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:08.971153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:09.159136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:09.163231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:09.167381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5e9be27a-9f2f-4085-982d-e9f8d37220b3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210873 Sep 05 15:01:09.168167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1597/3331] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:08 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:09.171637 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b024ee64-26d9-47a2-82ca-37bac08f35d3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218753 Sep 05 15:01:09.172542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1735/3332] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:09.419932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:09.420479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:09.426364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:09.426875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:09.427315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:09.428029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:09.428479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:09.428900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:09.491846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:09.500728 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:09.502164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:09.503297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a4f9ca58-f428-4de6-8566-1951bd3cfccb tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1285 microversion: 2.20 time: 0.087797 Sep 05 15:01:09.503859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1598/3333] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:09 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1285 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:10.191275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:10.192560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:10.194743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:10.195446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:10.199112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:10.199592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:10.200100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:10.201842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:10.202305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:10.202437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:10.202728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:10.202873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:10.203242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:10.203928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:10.204381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:10.204806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:10.411524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:10.419553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:10.420081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7970f2a9-3200-4d64-b014-45deddeac597 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.232900 Sep 05 15:01:10.420652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1736/3334] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:10 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:10.422700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-24791172-e5c2-424c-81d5-a21bcdf8648f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.231699 Sep 05 15:01:10.423371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1599/3335] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:10.527390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:10.528116 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:10.534125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:10.534673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:10.535137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:10.535814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:10.536258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:10.536676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:10.599422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:10.607534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:10.608767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:10.609850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-628b121c-15ca-4918-a05f-af7c3dd1cc91 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1333 microversion: 2.20 time: 0.086401 Sep 05 15:01:10.610398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1737/3336] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:10 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1333 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:11.443843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:11.444566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:11.445150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:11.445762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:11.451915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:11.452394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:11.454977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:11.455105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:11.455105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:11.455335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:11.455438 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:11.455530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:11.455530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:11.455722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:11.455722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:11.455722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:11.747432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:11.752992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:11.756632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-88bede69-6d87-4819-8a25-70389dd8b47f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.315071 Sep 05 15:01:11.757193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1738/3337] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:11.761707 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d02d25a3-c20b-4e77-a4c9-faf74b42a46b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.322010 Sep 05 15:01:11.762179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:11.762782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:11.768859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:11.769572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:11.770207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:11.771112 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:11.771745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:11.772342 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:11.775331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1600/3338] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:11 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:11.850328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:11.858770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:11.860261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:11.861387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-036ed2ae-910e-429a-82b1-6f971a6fa24d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1339 microversion: 2.20 time: 0.103027 Sep 05 15:01:11.862320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1739/3339] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:11 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1339 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:12.779840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:12.780561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:12.785317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:12.786253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:12.787327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:12.787812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:12.788488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:12.789192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:12.789649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:12.790072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:12.792804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:12.793407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:12.793837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:12.794736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:12.795212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:12.795689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:13.053179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:13.061780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-523a7a0c-d945-4401-a8d5-5ae741677f6e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.286083 Sep 05 15:01:13.062339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1601/3340] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:13.066996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:13.067770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:13.073655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:13.074145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:13.074574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:13.076118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:13.076569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:13.076989 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:13.080225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:13.093254 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8bc3349b-3a85-4e50-b0e2-86529828844b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.308450 Sep 05 15:01:13.094020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1740/3341] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:12 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:13.101478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:13.265183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-3b7ed5b7-59aa-4f51-9869-8e0f0446bc42 req-9842ac7f-2e11-4d8a-bb5e-81a5523889b3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ef78b-3501-4ec5-b8d3-ec4363e1a635", "tag": "c375dec3-11a1-42b6-899d-e5fdf7a2dd13"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:01:13.274168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:13.275785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-3b7ed5b7-59aa-4f51-9869-8e0f0446bc42 req-9842ac7f-2e11-4d8a-bb5e-81a5523889b3 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:13.276301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-3b7ed5b7-59aa-4f51-9869-8e0f0446bc42 req-9842ac7f-2e11-4d8a-bb5e-81a5523889b3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:13.276759 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-3b7ed5b7-59aa-4f51-9869-8e0f0446bc42 req-9842ac7f-2e11-4d8a-bb5e-81a5523889b3 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:13.283695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:13.285306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:13.286493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-534c40f0-b835-40a9-a221-1957662e20cf tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.223215 Sep 05 15:01:13.287092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1602/3342] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:13 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:13.288237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-3b7ed5b7-59aa-4f51-9869-8e0f0446bc42 req-9842ac7f-2e11-4d8a-bb5e-81a5523889b3 service nova] Creating event network-changed:c375dec3-11a1-42b6-899d-e5fdf7a2dd13 for instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 on hv-cinder-84290 Sep 05 15:01:13.293345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-3b7ed5b7-59aa-4f51-9869-8e0f0446bc42 req-9842ac7f-2e11-4d8a-bb5e-81a5523889b3 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089742 Sep 05 15:01:13.294726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1741/3343] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 15:01:14.088239 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:14.088837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:14.095628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:14.096116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:14.096557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:14.097740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:14.097740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:14.098097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:14.117349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:14.118392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:14.124874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:14.125744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:14.126056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:14.126744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:14.127233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:14.127657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:14.282410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:14.291378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-40f91f4b-ef6a-4444-8453-1ebdcf25b7d1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.207206 Sep 05 15:01:14.292063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1603/3344] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:14.304371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:14.313575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:14.314225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:14.314380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96cd5774-0515-41ef-9327-cedd5e048c31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.201661 Sep 05 15:01:14.315144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1742/3345] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:14 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:14.333190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:14.333684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:14.334118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:14.334828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:14.335288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:14.335708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:14.463442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:14.471569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:14.473062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:14.474167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-161b315e-dd0f-4d23-a6ee-d8753764adc0 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.165285 Sep 05 15:01:14.474723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1604/3346] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:14 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:15.315125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:15.315799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:15.322293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:15.322925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:15.323363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:15.324049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:15.324504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:15.324928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:15.339454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:15.340099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:15.342455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:15.347752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:15.348447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:15.348888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:15.349625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:15.350079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:15.350499 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:15.522419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:15.526108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:15.531169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bba7a4c7-70a8-41a1-9cc9-0bc6086a7a79 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.220003 Sep 05 15:01:15.532230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1743/3347] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:15.535326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d1c576d4-f75a-4df8-b95d-d63c18542ba4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.199597 Sep 05 15:01:15.535907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1605/3348] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:15 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:15.536933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:15.537536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:15.543262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:15.544001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:15.544667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:15.545427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:15.545948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:15.546536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:15.675107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:15.683355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:15.684832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:15.685934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8027a4c9-17da-433e-af38-bbd6f5a728b3 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.152822 Sep 05 15:01:15.686489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1744/3349] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:15 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:16.554282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:16.554856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:16.557382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:16.558183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:16.561886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:16.562378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:16.563156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:16.563538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:16.563993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:16.564419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:16.564567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:16.565247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:16.565689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:16.566383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:16.566868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:16.567300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:16.990053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:16.992974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:16.998670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2f2a9212-adba-431d-bd0b-7df1bafe31a0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.448355 Sep 05 15:01:16.999273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1606/3350] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:17.001611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce7dab43-e000-4948-a711-6e60e3132d25 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.448102 Sep 05 15:01:17.002497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1745/3351] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:16 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:17.003992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:17.004587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:17.010260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:17.010741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:17.011221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:17.011906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:17.012359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:17.013276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:17.139694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:17.147561 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:17.148995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:17.150090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fe2d99cd-9746-4ad8-9b03-b373d8d9758c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.149911 Sep 05 15:01:17.150649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1607/3352] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:16 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:18.022068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:18.022704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:18.024672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=8 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:18.024816 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:18.025280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:18.030747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.031271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.031709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.032142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.032442 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.032627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.032900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.033048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.033326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.033727 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.034178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.034595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.225353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:18.228455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:18.234325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ac2201c-bd5b-4458-a141-4ba512224bb8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216246 Sep 05 15:01:18.235131 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1746/3353] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:18.238211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83b0423a-bf63-4848-8261-2aaa84c0408e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217171 Sep 05 15:01:18.238901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1608/3354] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:18 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:18.243332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:18.243951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:18.249766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.250240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.250663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.251375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.251825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.252244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.266705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:18.384162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:18.392748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:18.394192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:18.395297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f48abbe3-3b3b-4cd0-a633-67217fb796f8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.159473 Sep 05 15:01:18.395938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1747/3355] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:18 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:18.726235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=10 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:18.779534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-5bcaf51f-3fff-4be5-a46b-7af953c8eb3b req-35879fc4-c988-4e4c-bf17-5dc3b34b34b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13ef78b-3501-4ec5-b8d3-ec4363e1a635", "name": "network-vif-plugged", "status": "completed", "tag": "c375dec3-11a1-42b6-899d-e5fdf7a2dd13"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:01:18.788915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-5bcaf51f-3fff-4be5-a46b-7af953c8eb3b req-35879fc4-c988-4e4c-bf17-5dc3b34b34b6 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:18.789413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-5bcaf51f-3fff-4be5-a46b-7af953c8eb3b req-35879fc4-c988-4e4c-bf17-5dc3b34b34b6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:18.789841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-5bcaf51f-3fff-4be5-a46b-7af953c8eb3b req-35879fc4-c988-4e4c-bf17-5dc3b34b34b6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:18.802262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-5bcaf51f-3fff-4be5-a46b-7af953c8eb3b req-35879fc4-c988-4e4c-bf17-5dc3b34b34b6 service nova] Creating event network-vif-plugged:c375dec3-11a1-42b6-899d-e5fdf7a2dd13 for instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 on hv-cinder-84290 Sep 05 15:01:18.807396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-5bcaf51f-3fff-4be5-a46b-7af953c8eb3b req-35879fc4-c988-4e4c-bf17-5dc3b34b34b6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085519 Sep 05 15:01:18.810072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1609/3356] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:01:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:01:19.256984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:19.257594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:19.261882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:19.262688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:19.264088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:19.264572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:19.265005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:19.265688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:19.266141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:19.266561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:19.269149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:19.269627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:19.270059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:19.270736 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:19.271227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:19.271649 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:19.457359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:19.463925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:19.465222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-41d406d6-7e71-400e-b5a3-ff5356cce8ee tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212211 Sep 05 15:01:19.466046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1748/3357] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:19.470265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:19.471016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:19.472323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2ec7994e-eca9-45e6-8b69-e89317d5cfe5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.214931 Sep 05 15:01:19.473126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1610/3358] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:19 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:19.476704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:19.477181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:19.477781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:19.478471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:19.478949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:19.479372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:19.605507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:19.614143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:19.615606 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:19.616697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-18bf3472-99c6-4a00-bd0d-5a08c07563d6 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.149949 Sep 05 15:01:19.617244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1749/3359] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:19 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:20.490762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:20.491439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:20.495159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:20.495895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:20.498746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:20.499262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:20.499701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:20.500393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:20.500846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:20.501278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:20.502944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:20.503428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:20.503865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:20.504549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:20.505002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:20.505423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:20.695330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:20.698781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:20.703783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-874590e4-f9dd-4de4-bbd2-6eaed31f35a1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216983 Sep 05 15:01:20.704361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1611/3360] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:20.707469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-da5fd855-4487-499a-9bc4-3507dda924e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216342 Sep 05 15:01:20.708183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1750/3361] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:20 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:20.709159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:20.709783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:20.715455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:20.715936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:20.719286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:20.719286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:20.719286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:20.719286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:20.847418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:20.855297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:20.857274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:20.858362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4491349f-e6c7-44f5-9359-81325389aa39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1407 microversion: 2.20 time: 0.153089 Sep 05 15:01:20.858956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1612/3362] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:20 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:21.726689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:21.727317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:21.730220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:21.730846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:21.733755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:21.734234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:21.734666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:21.735383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:21.735836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:21.736255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:21.737270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:21.737746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:21.738175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:21.738873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:21.739326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:21.739742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:21.930480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:21.934602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:21.939000 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6da504a2-78b4-4169-a1ca-6b9d6e12efa5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216170 Sep 05 15:01:21.940650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1751/3363] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:21.942990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f222cb9c-d5fe-4d2c-bf4b-8c690f77a1bb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216496 Sep 05 15:01:21.943718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1613/3364] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:21 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:21.945816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:21.946414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:21.952311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:21.952884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:21.953316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:21.953992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:21.954441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:21.954884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:22.082103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:22.090050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:22.092052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:22.093257 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8f0c8c84-971d-4d10-9a62-776f359d3263 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1598 microversion: 2.20 time: 0.152655 Sep 05 15:01:22.094499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1752/3365] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:01:21 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1598 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:01:22.118629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:22.119169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:22.125028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:22.125504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:22.125933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:22.126606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:22.127148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:22.127566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:22.202003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8b1e8d95-e251-4913-9f0d-846c5a3a180d tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.087507 Sep 05 15:01:22.202581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1614/3366] 10.222.0.15 () {60 vars in 1316 bytes} [Mon Sep 5 15:01:22 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 15:01:22.961600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:22.962882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:22.965731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:22.966359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:22.970163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:22.970743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:22.971218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:22.971894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:22.972374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:22.972792 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:22.972929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:22.973304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:22.973709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:22.974598 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:22.975094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:22.975522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:23.248967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:23.255857 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:23.257570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ef29526a-5c3f-434e-bcc9-58607469f551 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.296138 Sep 05 15:01:23.258424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1615/3367] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:22 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:23.280211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d091e87-0c97-4325-8f1f-2f8cf808a311 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.322552 Sep 05 15:01:23.280780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1753/3368] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:23.348580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-b6b06110-8d8d-4acc-ad2a-0013b9cea81b req-a9cc1151-81fb-42d1-bf11-8de06b0921e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f13ef78b-3501-4ec5-b8d3-ec4363e1a635", "tag": "c375dec3-11a1-42b6-899d-e5fdf7a2dd13"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:01:23.358262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b6b06110-8d8d-4acc-ad2a-0013b9cea81b req-a9cc1151-81fb-42d1-bf11-8de06b0921e7 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:23.358742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b6b06110-8d8d-4acc-ad2a-0013b9cea81b req-a9cc1151-81fb-42d1-bf11-8de06b0921e7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:23.359196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b6b06110-8d8d-4acc-ad2a-0013b9cea81b req-a9cc1151-81fb-42d1-bf11-8de06b0921e7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:23.372953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-b6b06110-8d8d-4acc-ad2a-0013b9cea81b req-a9cc1151-81fb-42d1-bf11-8de06b0921e7 service nova] Creating event network-changed:c375dec3-11a1-42b6-899d-e5fdf7a2dd13 for instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 on hv-cinder-84290 Sep 05 15:01:23.378078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-b6b06110-8d8d-4acc-ad2a-0013b9cea81b req-a9cc1151-81fb-42d1-bf11-8de06b0921e7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033209 Sep 05 15:01:23.378682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1616/3369] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:01:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:01:24.282180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:24.283338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:24.296704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:24.296704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:24.296704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:24.298780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:24.299550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:24.300007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:24.304298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:24.304977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:24.311252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:24.311945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:24.312583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:24.313240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:24.313686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:24.314102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:24.506206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:24.509744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:24.515282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1091c44a-780e-4637-b59b-cf39dd2e484f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.237579 Sep 05 15:01:24.515936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1754/3370] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:24 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:24.518663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-42098218-dcac-4bcb-96f0-24b05b464ac0 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218939 Sep 05 15:01:24.519235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1617/3371] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:25.538921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:25.539539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:25.541193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:25.541839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:25.546599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:25.547124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:25.547555 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:25.548239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:25.548370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:25.548686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:25.548811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:25.549107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:25.549222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:25.549880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:25.550330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:25.550750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:25.744884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:25.749126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:25.753545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b366c875-482a-46ff-9bb5-aedbd6bc35f9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.218569 Sep 05 15:01:25.754351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1755/3372] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:25 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:25.757616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-325a7832-04cd-4981-a8de-a0b356d04d9c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.220222 Sep 05 15:01:25.758254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1618/3373] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:26.778071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:26.779373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:26.781215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:26.781815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:26.786129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:26.786615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:26.787086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:26.787814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:26.788138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:26.788260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:26.788618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:26.788752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:26.789051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:26.789737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:26.790184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:26.790609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:26.976474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:26.982932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:26.985224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aac4c802-4cf1-4de7-a5c8-04648a745ce7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211107 Sep 05 15:01:26.985900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1756/3374] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:26 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:26.991369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-25899db2-6a7a-4274-a676-5fafc855f83a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214508 Sep 05 15:01:26.991968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1619/3375] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:28.008859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:28.009497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:28.014866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:28.015474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:28.015932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:28.016406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:28.016831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:28.017512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:28.017957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:28.018371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:28.021885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:28.022376 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:28.022802 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:28.023487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:28.023934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:28.024351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:28.211223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:28.214506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:28.217393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:28.220087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-607cf60b-b4a7-4aa5-81ae-2381f15559a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215061 Sep 05 15:01:28.220854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1757/3376] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:28 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:28.224161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-454374e8-bc75-40f2-b76c-584a86e39d80 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213153 Sep 05 15:01:28.224733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1620/3377] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:28 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:29.243084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:29.243947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:29.246782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:29.247422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:29.250370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:29.250910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:29.251349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:29.252031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:29.252473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:29.252887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:29.254547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:29.255068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:29.255508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:29.256196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:29.256653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:29.257078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:29.439548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:29.446136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:29.448124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-493d89c3-38ec-4033-9b35-8e6d632cfee0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.208912 Sep 05 15:01:29.448772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1758/3378] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:29 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:29.455415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d7a4296f-194e-40f2-af02-1b18eb64a31f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212628 Sep 05 15:01:29.455976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1621/3379] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:30.472416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:30.473038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:30.478423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:30.478956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:30.479625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:30.480108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:30.480554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:30.481247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:30.481757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:30.482190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:30.485059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:30.485541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:30.485975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:30.486660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:30.487141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:30.487567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:30.901229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:30.904334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:30.909545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cf7a533d-1d6c-4989-ab0b-da8668806111 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.441018 Sep 05 15:01:30.910203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1759/3380] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:30 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:30.912509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc17a6b9-f6f4-40ae-b640-8d97c3d08276 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.437825 Sep 05 15:01:30.913280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1622/3381] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:31.932797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:31.933353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:31.935546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:31.936149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:31.940291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:31.940818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:31.941247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:31.941926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:31.942373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:31.942801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:31.943133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:31.943614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:31.944047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:31.944732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:31.945183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:31.945606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:32.133939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:32.137920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:32.142050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9345bcbc-e52e-466b-9e4f-7d18352051c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213269 Sep 05 15:01:32.142590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1760/3382] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:31 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:32.146187 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-56ae96b4-8e6e-4236-807a-7b19dc171d4d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214541 Sep 05 15:01:32.146747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1623/3383] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:33.165002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:33.165618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:33.168681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:33.169293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:33.172970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:33.173459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:33.173904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:33.174615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:33.175121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:33.175546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:33.176338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:33.176850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:33.177285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:33.177974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:33.178427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:33.178868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:33.369861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:33.373595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:33.378048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c5c3b2a5-5ffa-4f5b-b7b0-a6dab4bb8c5f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216917 Sep 05 15:01:33.378620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1761/3384] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:33 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:33.381648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ad308eb0-cda6-47f7-a13b-05f514942a0a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216827 Sep 05 15:01:33.382199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1624/3385] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:33 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:34.400920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:34.401483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:34.404897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:34.405509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:34.409215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:34.409700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:34.410130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:34.410841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:34.411300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:34.411718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:34.412650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:34.413132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:34.413569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:34.414296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:34.414758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:34.415215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:34.603788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:34.607633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:34.612091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1680127b-b6dc-45e1-8850-7cae4b57e599 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215048 Sep 05 15:01:34.612664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1762/3386] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:34 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:34.615892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ec66aec-3bf0-4692-aecd-197f749d15e8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214942 Sep 05 15:01:34.616448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1625/3387] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:35.636014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:35.636630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:35.638764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:35.639183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=70 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:35.639411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:35.641829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:35.643723 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:35.644204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:35.644643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:35.645337 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:35.645793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:35.646217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:35.646396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:35.646917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:35.647358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:35.648053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:35.648508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:35.648941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:35.837076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:35.843996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:35.845139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7bbe91af-27e8-4932-bb23-55cf0e1c9016 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210129 Sep 05 15:01:35.845713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1626/3388] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:35.852548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8c7181a6-1424-4557-aba1-2565f3200b46 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220482 Sep 05 15:01:35.853107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1763/3389] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:36.868237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:36.869100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:36.875706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:36.875851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:36.876284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:36.876403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:36.876609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:36.877271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:36.877723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:36.878148 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:36.882552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:36.883059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:36.883488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:36.884161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:36.884605 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:36.885021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:36.888894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:37.070708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:37.073399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:37.080211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-86b06d01-5e4f-4507-aeda-6510d96f9399 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215263 Sep 05 15:01:37.080786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1627/3390] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:37.082193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f9564e92-f47b-4d29-82bc-382ed6b15c29 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210152 Sep 05 15:01:37.082848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1764/3391] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:38.103665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:38.104292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:38.105258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:38.105865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:38.110876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:38.111371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:38.111808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:38.112219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:38.112506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:38.112696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:38.112964 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:38.113121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:38.113390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:38.113793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:38.114242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:38.114658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:38.338333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:38.351962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ee8e6bc0-298d-4d74-94ff-52a797392c16 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.247040 Sep 05 15:01:38.351962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1628/3392] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:38 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:38.352382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:38.361049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d6c92ab-5401-434b-af77-8078864bdf39 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.259538 Sep 05 15:01:38.361621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1765/3393] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:38 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:39.369758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:39.370406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:39.377462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:39.377937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:39.378367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:39.379070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:39.379521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:39.379946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:39.384845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:39.385496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:39.387657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:01:39.387822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:01:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 (ip 10.222.0.15) !!! Sep 05 15:01:39.393957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:39.394445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:39.394916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:39.395626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:39.396072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:39.396498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:39.576922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:39.583689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:39.585020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ca004924-f17a-4c56-9b06-1cfadbe814e1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219385 Sep 05 15:01:39.585590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1629/3394] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:39.592057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-795df1b7-9a3e-401c-8524-95260e1cc384 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211007 Sep 05 15:01:39.592609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1766/3395] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:39 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:40.608289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:40.608968 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:40.614860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:40.615478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:40.615997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:40.616495 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:40.616921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:40.617620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:40.618076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:40.618754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:40.622070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:40.623872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:40.623872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:40.623872 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:40.624227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:40.624530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:40.812402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:40.819116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:40.820677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f27b970e-b240-4459-b86c-e7dc570f1846 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210161 Sep 05 15:01:40.821260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1767/3396] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:40.827444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cd549c23-10db-4583-ab24-9d4204059b4f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223010 Sep 05 15:01:40.828004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1630/3397] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:41.844306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:41.844975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:41.850988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:41.851597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:41.852079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:41.852575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:41.853010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:41.853893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:41.854360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:41.854817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:41.858077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:41.858548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:41.859017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:41.859760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:41.860212 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:41.860641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:42.046852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:42.051259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:42.055866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-812f4d49-4d65-4eeb-a66e-9be2e3397762 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215419 Sep 05 15:01:42.056436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1768/3398] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:41 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:42.059356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0b884203-da5f-428e-870f-dead5b15c666 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212323 Sep 05 15:01:42.059920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1631/3399] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:43.078852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:43.079552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:43.081150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:43.081758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:43.086054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:43.086682 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:43.087012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:43.087698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:43.088083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:43.088201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:43.088565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:43.088690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:43.088999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:43.089683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:43.090138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:43.090565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:43.356202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:43.363405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:43.364988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6fbc802d-fe83-4d99-8613-80b3e01c4bec tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.290153 Sep 05 15:01:43.365563 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1769/3400] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:43 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:43.371762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-90af6650-b77a-4701-b9dc-588d181eeb50 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.294384 Sep 05 15:01:43.372314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1632/3401] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:43 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:44.388958 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:44.389508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:44.395505 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:44.396150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:44.396582 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:44.397063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:44.397494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:44.398179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:44.398625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:44.399066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:44.402425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:44.403136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:44.403574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:44.404263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:44.404723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:44.405145 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:44.593631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:44.596560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:44.601955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66eaedea-2fb7-4a6c-8e8a-47b6e08ad1ad tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216934 Sep 05 15:01:44.602524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1770/3402] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:44 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:44.604830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-07956e0d-7f8c-4f52-9e5a-4ad5f5d09463 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213685 Sep 05 15:01:44.605402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1633/3403] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:45.625548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:45.626779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:45.628752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:45.629366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:45.633570 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:45.634151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:45.634451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:45.635206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:45.635635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:45.636058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:45.637014 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:45.637502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:45.637945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:45.638634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:45.639122 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:45.639546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:45.830307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:45.835114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:45.838620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-62a00585-a224-42a9-8632-a0542ff2b275 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217032 Sep 05 15:01:45.839500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1771/3404] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:45 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:45.843260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a5495959-5b7d-47e4-9496-15d00b39c62f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218815 Sep 05 15:01:45.843934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1634/3405] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:46.862155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:46.862718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:46.865893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:46.866536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:46.869398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:46.869884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:46.870330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:46.871068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:46.871526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:46.871945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:46.873226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:46.873729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:46.874219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:46.874932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:46.875391 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:46.875819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:47.065881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:47.069631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:47.074647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f78f925f-9333-43ee-90d5-0d742987b350 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216464 Sep 05 15:01:47.075641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1772/3406] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:47.078350 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d09e9f49-e1bd-47b6-b9ab-73489f8de42e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216352 Sep 05 15:01:47.081864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1635/3407] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:48.098043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:48.098650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:48.101755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:48.102526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:48.105055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:48.105534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:48.105966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:48.106677 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:48.107149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:48.107566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:48.108853 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:48.109335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:48.109764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:48.110446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:48.111037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:48.112032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:48.302252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:48.305683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:48.310666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c75653ca-e0b6-4552-8ce7-507e7167386c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212695 Sep 05 15:01:48.311276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1636/3408] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:48 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:48.313928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-72e62654-dfec-4b1e-aa86-bba39e46d4df tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220325 Sep 05 15:01:48.314622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1773/3409] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:48 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:49.334226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:49.334862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:49.337386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:49.338032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:49.341321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:49.341805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:49.342242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:49.343232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:49.343693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:49.344118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:49.344684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:49.345165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:49.345599 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:49.346287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:49.346828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:49.347197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:49.359015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:49.535977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:49.539098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:49.544421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-25fa7bf9-0279-403d-ae00-ae1fed0ffd8e tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214130 Sep 05 15:01:49.545277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1637/3410] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:49.547173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a540422a-5848-4046-a345-3fafafb31201 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213655 Sep 05 15:01:49.547721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1774/3411] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:50.570842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:50.571853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:50.572873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:50.573494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:50.580640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:50.581190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:50.581414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:50.581616 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:50.581927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:50.582301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:50.582434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:50.582748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:50.583187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:50.583326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:50.583652 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:50.584100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:50.789587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:50.792806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:50.797975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c01fe4db-a7c7-4016-81a2-2185141ac631 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.231592 Sep 05 15:01:50.798912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1775/3412] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:50.801879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b65f5fc8-5a69-46d6-9984-0279081ca297 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.236687 Sep 05 15:01:50.802430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1638/3413] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:51.821277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:51.822058 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:51.826244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:51.827672 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:51.829997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:51.830445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:51.830908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:51.831611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:51.832168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:51.832608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:51.835410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:51.835895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:51.836332 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:51.837338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:51.837869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:51.838366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:52.035843 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:52.038971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:52.044808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-23958613-de78-4ed8-b9b6-049af66f5183 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.227527 Sep 05 15:01:52.045384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1776/3414] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:51 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:52.047245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e78fcbca-fbbe-417e-9791-e5e0489e582d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.226166 Sep 05 15:01:52.047844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1639/3415] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:53.067756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:53.068363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:53.072921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:53.073537 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:53.075545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:53.076034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:53.076468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:53.077162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:53.077611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:53.078029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:53.080723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:53.081205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:53.081641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:53.082334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:53.082818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:53.083232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:53.281589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:53.285937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:53.289957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7b4b8d9-4760-45b1-94b4-480424857049 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.222163 Sep 05 15:01:53.290533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1640/3416] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:53 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:53.294169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-15065d27-491f-44e2-8b6a-cf1482cc1a75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.230874 Sep 05 15:01:53.294733 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1777/3417] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:53 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:54.314701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:54.315321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:54.318700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:54.319368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:54.321803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:54.322310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:54.322902 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:54.323604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:54.324060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:54.324489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:54.325652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:54.326375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:54.326962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:54.327645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:54.328099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:54.328518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:54.532181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:54.535945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:54.541153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5197941a-086c-4560-94de-eb1d8db33728 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.230373 Sep 05 15:01:54.541835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1641/3418] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:54.544720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-28b3038c-7c63-4f29-abad-2aeb963da96f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.229785 Sep 05 15:01:54.545286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1778/3419] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:54 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:55.563408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:55.564055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:55.568557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:55.569301 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:55.571131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:55.571617 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:55.572052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:55.572744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:55.573193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:55.573616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:55.575641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:55.576127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:55.576564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:55.577250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:55.577708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:55.578132 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:55.766316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:55.769579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:55.774741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ed9fed4f-7ffc-48c9-a379-f69c3153efaf tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215164 Sep 05 15:01:55.777731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1642/3420] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:55.778184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0c17ec8f-37eb-4a68-b055-348ebcd0487c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213999 Sep 05 15:01:55.778831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1779/3421] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:55 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:56.798682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:56.799340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:56.800892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:56.801502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:56.805726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:56.806205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:56.806636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:56.807348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:56.807788 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:56.807915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:56.808204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:56.808315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:56.808679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:56.809353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:56.809802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:56.810216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:57.000425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:57.005036 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:57.007455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:01:57.009172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-360ffd8e-24fe-4b5a-a452-7140550f4896 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214352 Sep 05 15:01:57.009933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1643/3422] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:57.014261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b49cb893-12f3-48c0-bda1-801bed0839c7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217126 Sep 05 15:01:57.015010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1780/3423] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:56 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:58.033054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:58.033673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:58.040285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:58.040767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:58.041228 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:58.041912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:58.042361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:58.042780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:58.044053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:58.044666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:58.051565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:58.052044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:58.052473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:58.053156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:58.053604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:58.054023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:58.237247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:58.240389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:58.246179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d45bf53-30ce-4986-a9cd-01b75c66deff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.206253 Sep 05 15:01:58.246757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1781/3424] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:58 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:01:58.248826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4f03097a-1417-4792-8415-725f079c041c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219642 Sep 05 15:01:58.249383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1644/3425] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:59.269875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:59.270508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:59.271359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:01:59.271969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:01:59.277066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:59.277554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:59.277995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:59.278117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:59.278584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:59.278716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:59.279054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:59.279194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:59.279580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:59.279733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:01:59.280180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:01:59.280600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:01:59.471129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:59.474245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:01:59.479269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5fb71cb6-739a-4576-a700-3491f8cfdcf3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213384 Sep 05 15:01:59.479842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1782/3426] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:59 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:01:59.482364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c952e998-2232-455c-b9f6-b951ef63874a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214863 Sep 05 15:01:59.482944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1645/3427] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:01:59 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:00.503695 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:00.504300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:00.505638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:00.506245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:00.510767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:00.511281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:00.511714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:00.512397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:00.512514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:00.512850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:00.512991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:00.513268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:00.513383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:00.514034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:00.514479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:00.514926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:00.706089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:00.708942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:00.714471 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ac3fc7eb-d71f-4388-82e7-7fe43a9180b6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215275 Sep 05 15:02:00.715074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1783/3428] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:00 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:00.717004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d9ab5372-031b-4ed3-85e0-c68cdf1641f6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215660 Sep 05 15:02:00.717640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1646/3429] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:01.737937 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:01.738504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:01.741093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:01.741769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:01.745325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:01.745799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:01.746231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:01.746943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:01.747390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:01.747802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:01.748279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:01.748764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:01.749201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:01.749884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:01.750337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:01.750765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:02.158820 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:02.167128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7a8ab1a-b025-4141-8386-78bfac9e9943 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.433551 Sep 05 15:02:02.169029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1784/3430] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:01 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:02.169922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:02.178807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-141c6728-2163-4ffc-b48c-3349b2ca101a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.441438 Sep 05 15:02:02.179360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1647/3431] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:03.191698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:03.192400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:03.198881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:03.199388 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:03.199790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:03.200474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:03.200925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:03.201345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:03.201809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:03.201966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:03.209104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:03.209587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:03.210024 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:03.210721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:03.211211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:03.211633 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:03.397294 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:03.400167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:03.405782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b5fb8f45-a80d-464b-a5f9-efefccd7e7ba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.208277 Sep 05 15:02:03.406355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1648/3432] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:03.408373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-40091e4d-97b9-450e-b7e3-622487aee34d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.221081 Sep 05 15:02:03.408982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1785/3433] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:03 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:04.429654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:04.430206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:04.430992 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:04.431946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:04.436741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:04.437219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:04.437648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:04.438206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:04.438335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:04.438693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:04.438854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:04.439674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:04.439932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:04.440624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:04.441082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:04.441506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:04.628881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:04.632877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:04.637015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eba8ff39-e180-4581-ad6d-455566cf2ad4 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211363 Sep 05 15:02:04.637582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1649/3434] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:04 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:04.641070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-29f9cede-f12b-42b9-9004-0a6d2a784214 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213840 Sep 05 15:02:04.641645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1786/3435] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:04 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:05.661146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:05.661790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:05.664906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:05.665515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:05.668315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:05.668803 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:05.669242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:05.669933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:05.670399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:05.670818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:05.671827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:05.672304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:05.672734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:05.673408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:05.673856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:05.674274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:05.860252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:05.864316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:05.868586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-48d90c96-e501-4f97-b1a0-6b3a0a861315 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212030 Sep 05 15:02:05.869426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1650/3436] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:05.872708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d7924a81-6e6a-417a-8908-c4e94d368194 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211657 Sep 05 15:02:05.873263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1787/3437] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:05 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:06.892160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:06.893384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:06.895769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=50 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:06.896855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:06.897467 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:06.899774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=50 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:06.900424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:06.900906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:06.901340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:06.902027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:06.902472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:06.902920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:06.904379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:06.904860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:06.905297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:06.906034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:06.906491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:06.906945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:07.096482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:07.100044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:07.104685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fd2dcf17-3a1a-4b2d-8333-2b6da2f89208 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216506 Sep 05 15:02:07.105261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1651/3438] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:07.108046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c77e4217-cfc3-40f4-ac7b-77808861744f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215714 Sep 05 15:02:07.108598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1788/3439] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:06 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:08.129259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:08.129880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:08.131952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:08.132545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:08.136389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:08.139159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:08.139159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:08.139159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:08.139159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:08.139657 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:08.139762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:08.139762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:08.139762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:08.140414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:08.140863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:08.141280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:08.331856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:08.336212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:08.344887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-483ebada-7b66-42cf-8eed-45b3f559c807 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215642 Sep 05 15:02:08.344887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1652/3440] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:08.345297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6e49e903-99bf-4902-b4e8-b19530dd40e2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216309 Sep 05 15:02:08.346057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1789/3441] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:08 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:09.364025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:09.364575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:09.367458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:09.369832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:09.371453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:09.371939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:09.372378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:09.373282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:09.373583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:09.374012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:09.376552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:09.377037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:09.377474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:09.378173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:09.378629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:09.379206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:09.569820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:09.576470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:09.578199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49c6a43f-47f3-4eaa-8602-a7e21c59e592 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218324 Sep 05 15:02:09.578779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1653/3442] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:09 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:09.585261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7dbf0f4e-b9ba-4528-8623-75da919c815c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.221629 Sep 05 15:02:09.585809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1790/3443] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:09 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:10.602257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:10.602896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:10.607874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:10.608499 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:10.609368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:10.609834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:10.610271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:10.611046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:10.612039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:10.612779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:10.615722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:10.616206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:10.616407 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:10.616643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:10.617333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:10.617787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:10.618209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:10.809290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:10.812048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:10.818221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c2fd27d-15b7-4ea2-9e72-6b901be7bee9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.219842 Sep 05 15:02:10.818898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1654/3444] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:10.820771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bc086c85-fe23-4298-b6ca-4907212130b1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216810 Sep 05 15:02:10.821333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1791/3445] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:10 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:11.840616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:11.841232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:11.843317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:11.845236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:11.848783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:11.849276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:11.849715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:11.850408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:11.850895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:11.851040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:11.851322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:11.851503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:11.851939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:11.852625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:11.853076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:11.853498 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:12.045718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:12.049702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:12.054165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4fdad5cd-c85d-4de7-bc50-54b7441dfa22 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217388 Sep 05 15:02:12.055454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1655/3446] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:12.057813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2d29fc81-8cd6-45ef-b148-45312281773b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.218323 Sep 05 15:02:12.058384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1792/3447] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:11 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:13.077481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:13.078082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:13.081542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:13.082150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:13.085217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:13.085710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:13.086152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:13.086873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:13.087334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:13.087764 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:13.088572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:13.089166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:13.089597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:13.090721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:13.091200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:13.092882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:13.284029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:13.287316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:13.292576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c965795b-7844-4405-960b-2b30a993498d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218986 Sep 05 15:02:13.293264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1656/3448] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:13.295700 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4302dea4-16dc-4d20-a3ed-22e6a97a3560 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.218549 Sep 05 15:02:13.296252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1793/3449] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:13 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:14.315528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:14.316185 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:14.318204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:14.318862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:14.322455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:14.322978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:14.323413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:14.324096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:14.324549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:14.324972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:14.325128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:14.325536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:14.325965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:14.326639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:14.327123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:14.327539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:14.516049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:14.519363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:14.524775 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d009eb9b-8bba-4eb1-9f81-5fc5dc2af60c tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213125 Sep 05 15:02:14.525342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1657/3450] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:14 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:14.527377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7450664b-048a-485f-ae0f-e468562aa745 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213068 Sep 05 15:02:14.527933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1794/3451] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:14 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:15.548944 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:15.549550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:15.550749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:15.551383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:15.555937 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:15.556417 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:15.556846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:15.557526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:15.557657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:15.557973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:15.558088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:15.558389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:15.558500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:15.559179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:15.559626 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:15.560040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:15.746904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:15.750090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:15.755140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0623a010-e020-4317-ac6a-96aff8a9ec37 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210485 Sep 05 15:02:15.755798 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1658/3452] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:15 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:15.758314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-99b4ba9f-3a83-4b51-b937-aed72a072d31 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211938 Sep 05 15:02:15.758911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1795/3453] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:15 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:16.777374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:16.778042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:16.786217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:16.786387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:16.786865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:16.786995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:16.787142 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:16.787826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:16.788282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:16.788702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:16.792660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:16.793141 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:16.793574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:16.794258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:16.794715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:16.795168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:16.980251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:16.983332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:16.988674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cb21fa82-64af-492b-a156-a3def6c1cfec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215172 Sep 05 15:02:16.989251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1659/3454] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:16 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:16.991428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b5d0be16-fb59-4071-a245-454c2a093c68 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210824 Sep 05 15:02:16.992043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1796/3455] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:16 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:18.012223 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:18.012916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:18.017628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:18.018242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:18.019397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:18.019885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:18.020317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:18.021008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:18.021465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:18.021890 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:18.024655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:18.025130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:18.025558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:18.026237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:18.026687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:18.027174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:18.042251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:18.214411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:18.218271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:18.223507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-27fc76ce-1d08-46f0-8a27-b1efe902a7c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215261 Sep 05 15:02:18.224172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1660/3456] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:18 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:18.227312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-54d454e4-8807-413a-8c8e-c07d417196d7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213471 Sep 05 15:02:18.227874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1797/3457] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:18 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:19.247404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:19.248018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:19.250665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:19.251439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:19.255057 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:19.255575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:19.256008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:19.256700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:19.257161 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:19.257576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:19.258322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:19.258832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:19.259275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:19.259960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:19.260412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:19.260836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:19.448022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:19.451225 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:19.456217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-52030cdc-9f3e-4b75-bc81-286de4a189e2 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213067 Sep 05 15:02:19.456991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1661/3458] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:19 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:19.460522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-22e709d5-50c3-4a9a-9982-cab13055f40c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213697 Sep 05 15:02:19.461078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1798/3459] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:19 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:20.480081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:20.480699 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:20.483456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:20.484099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:20.487859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:20.488348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:20.488785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:20.489497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:20.489955 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:20.490379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:20.491111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:20.491595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:20.492028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:20.492709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:20.493167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:20.493586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:20.681502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:20.684659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:20.689760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-539e7173-813c-481e-93dd-b05a278b61a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210041 Sep 05 15:02:20.690382 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1799/3460] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:20 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:20.692938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-970d60e8-1a9b-4859-89e7-4e4ef8c8e839 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216858 Sep 05 15:02:20.693502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1662/3461] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:20 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:21.713245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:21.713839 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:21.716250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:21.716871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:21.721191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:21.721673 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:21.722103 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:21.722814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:21.723261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:21.723704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:21.723827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:21.724222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:21.724659 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:21.725347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:21.725807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:21.726235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:21.910687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:21.918823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-51b693b8-beb6-4a89-8f90-c606c50df96c tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209499 Sep 05 15:02:21.919390 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1800/3462] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:21 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:21.921872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:21.930776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e86e55c9-e70e-4857-9b0c-d18ee5e4e1eb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218385 Sep 05 15:02:21.931353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1663/3463] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:21 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:22.942829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:22.943447 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:22.949859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:22.950335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:22.950764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:22.951479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:22.951929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:22.952346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:22.953355 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:22.953958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:22.960389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:22.960858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:22.961288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:22.961966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:22.962413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:22.962851 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:23.148810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:23.152876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:23.157451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e0f185c7-2517-40f8-80fc-e1d8a1df0592 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219216 Sep 05 15:02:23.158017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1801/3464] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:22 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:23.161693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5c2a91f1-6fb6-4bf5-8791-1adbd465edd5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212200 Sep 05 15:02:23.162251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1664/3465] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:22 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:24.181567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:24.182181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:24.188596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:24.189077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:24.189516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:24.190196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:24.190648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:24.191602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:24.203966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:24.204571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:24.211526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:24.212003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:24.212454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:24.213120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:24.213570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:24.213991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:24.393484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:24.396719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:24.401631 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c374f08f-3079-480f-9070-57f4a185dc09 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.223951 Sep 05 15:02:24.402209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1802/3466] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:24 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:24.405373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-39708449-5c1f-4d54-935f-e6105afb564a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.205405 Sep 05 15:02:24.405942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1665/3467] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:24 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:25.424680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:25.425234 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:25.428059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:25.428697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:25.431718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:25.432201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:25.432627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:25.433306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:25.433754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:25.434168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:25.435009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:25.435497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:25.435934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:25.436619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:25.437069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:25.437494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:25.623288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:25.630518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:25.631803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-84bc6361-363e-489d-9034-ae23184b42fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211146 Sep 05 15:02:25.632373 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1803/3468] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:25 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:25.638852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18d2ed2c-3cb8-4c7f-9e6b-e3baa48723a3 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214597 Sep 05 15:02:25.639410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1666/3469] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:25 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:26.656485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:26.657125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:26.663101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:26.663711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:26.664161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:26.664638 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:26.665066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:26.665774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:26.666221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:26.666659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:26.669858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:26.670335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:26.670770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:26.671548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:26.672000 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:26.672421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:26.855274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:26.862140 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:26.864578 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4156a995-fbb6-4634-abb1-c00f71299371 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211999 Sep 05 15:02:26.865174 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1804/3470] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:26 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:26.871868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7691457a-0017-41eb-b477-a6075bae86a7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213202 Sep 05 15:02:26.872431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1667/3471] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:26 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:27.888043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:27.888660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:27.895018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:27.896054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:27.896193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:27.896326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:27.896752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:27.897440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:27.897951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:27.898379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:27.902112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:27.902585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:27.903056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:27.903769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:27.904219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:27.904644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:28.087912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:28.094364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:28.100357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-68a695ba-c4db-4752-aeda-7d582c6191dc tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209684 Sep 05 15:02:28.100932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1668/3472] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:27 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:28.102421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4f382db-62b4-4ec1-8c7f-7610f431e2cf tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.218274 Sep 05 15:02:28.103003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1805/3473] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:27 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:29.124400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:29.125107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:29.125504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:29.125720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:29.132098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:29.132574 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:29.132701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:29.133003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:29.133125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:29.133503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:29.133682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:29.134133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:29.134270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:29.134551 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:29.134663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:29.135053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:29.321422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:29.325635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:29.329684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-648ef764-5729-4659-8f1f-24d1b1a7f13b tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209157 Sep 05 15:02:29.330256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1669/3474] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:29 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:29.334660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd9abb1b-7607-470e-a5ed-acee5e8d0d6e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213289 Sep 05 15:02:29.335258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1806/3475] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:29 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:30.353921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:30.354528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:30.357277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:30.357884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:30.361033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:30.361515 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:30.361948 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:30.362667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:30.363144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:30.363566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:30.364276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:30.364748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:30.365178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:30.365852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:30.366300 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:30.366716 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:30.554318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:30.556514 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:30.558560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:30.563229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c547289a-a8e3-456d-a777-93d4399a3806 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213182 Sep 05 15:02:30.563813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1670/3476] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:30 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:30.567002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0fa14048-dc01-43c7-8567-0ba2dd3c5a83 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213462 Sep 05 15:02:30.568180 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1807/3477] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:30 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:31.587096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:31.587735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:31.594198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:31.594383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:31.594822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:31.594967 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:31.595131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:31.595822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:31.596277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:31.596701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:31.601709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:31.602190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:31.602623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:31.603364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:31.603818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:31.604240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:31.790192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:31.794261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:31.798438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc23a5ce-2754-49f2-8660-e07093d4bfd9 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215587 Sep 05 15:02:31.799045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1671/3478] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:31 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:31.802539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3babc5a8-8f6b-480b-bb92-f29134d260a0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.212036 Sep 05 15:02:31.803118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1808/3479] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:31 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:32.820722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:32.821320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:32.825146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:32.825753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:32.827886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:32.828367 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:32.828797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:32.829518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:32.829993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:32.830445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:32.832044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:32.832520 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:32.832954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:32.833632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:32.834082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:32.834500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:33.023478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:33.030146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:33.031614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-541a4b5a-ae92-4323-96b6-3fd07216032d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214910 Sep 05 15:02:33.032182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1672/3480] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:32 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:33.038812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b659a041-2c62-4091-bc42-b7640be3deca tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217473 Sep 05 15:02:33.039370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1809/3481] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:32 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:34.055615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:34.056231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:34.061747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:34.062358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:34.062754 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:34.063259 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:34.063694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:34.064373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:34.064821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:34.065240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:34.069018 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:34.069496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:34.069928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:34.070600 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:34.071073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:34.071493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:34.269351 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:34.276238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:34.278276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9b2f51e2-764b-444e-b4a4-63735f4b6f0e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220690 Sep 05 15:02:34.285304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-eb9f71a9-ff2d-47c9-89d0-639061d4ce23 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.234039 Sep 05 15:02:34.286871 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1673/3482] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:34 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:34.291313 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1810/3483] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:34 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:35.302403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:35.303104 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:35.311778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:35.311778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:35.312327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:35.312327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:35.312327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:35.312327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:35.312744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:35.312744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:35.316318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:35.316870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:35.317925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:35.318615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:35.319091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:35.319511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:35.498468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:35.507240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5ffd0eb8-d044-4177-b82e-4e9d611b1656 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.208779 Sep 05 15:02:35.510289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:35.511535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1674/3484] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:35.520179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ee46920-5a2b-4657-9716-f42f05fdc12d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.215965 Sep 05 15:02:35.520846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1811/3485] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:35 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:36.529437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:36.530038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:36.536965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:36.539188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:36.539188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:36.539188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:36.539188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:36.539611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:36.544861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:36.545461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:36.552745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:36.553221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:36.553650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:36.554329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:36.554780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:36.555226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:36.736301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:36.741107 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:36.745413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f0bb18da-6b7a-4938-ab57-b3d779f90d2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219801 Sep 05 15:02:36.745988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1675/3486] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:36.749514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-92d18db1-0d2b-4beb-9696-d08cf2d9b564 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.208490 Sep 05 15:02:36.750095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1812/3487] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:36 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:37.768748 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:37.769397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:37.771710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=50 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:37.773602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:37.774035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:37.775575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=50 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:37.776713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:37.777202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:37.777644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:37.778341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:37.778806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:37.781996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:37.782126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:37.782126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:37.782126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:37.782126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:37.782539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:37.782773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:37.969694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:37.976742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:37.977967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5db0f68c-9063-42ce-962d-f2ff0a927a5e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213090 Sep 05 15:02:37.978606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1676/3488] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:37 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:37.984878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2d06e5a9-007e-4f8f-99bc-f6d4645928bb tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216285 Sep 05 15:02:37.985435 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1813/3489] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:37 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:38.592997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:38.593488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:38.600050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:38.600540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:38.600973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:38.601656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:38.602105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:38.602527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:38.624800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-741d54e6-4e71-4255-acf3-5aed06daea70 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635/ips" status: 200 len: 151 microversion: 2.20 time: 0.035773 Sep 05 15:02:38.625358 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1677/3490] 10.222.0.15 () {60 vars in 1289 bytes} [Mon Sep 5 15:02:38 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 05 15:02:39.001629 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:39.002247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:39.008550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:39.009166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:39.009484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:39.009974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:39.010411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:39.011139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:39.011655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:39.012081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:39.015554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:39.016037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:39.016165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:39.016711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:39.017166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:39.017624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:39.018048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:39.201825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:39.210177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5f2f4a64-0c7d-44c3-8437-3a3e25fbbc2a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.212322 Sep 05 15:02:39.210550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1814/3491] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:38 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:39.212953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:39.221342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1be3909b-96b4-4541-ad09-6ab8d7e46170 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217243 Sep 05 15:02:39.221983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1678/3492] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:39 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:40.232901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:40.233516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:40.240544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:40.241024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:40.241456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:40.242135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:40.242585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:40.243035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:40.244298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:40.245321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:40.251381 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:40.251870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:40.252305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:40.252999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:40.253458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:40.253915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:40.655422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:40.658396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:40.667214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-88b05c38-f7ee-48a1-8e98-8523f6ca4ec1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.427116 Sep 05 15:02:40.667420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-312898b2-2b3c-402e-a54b-1c283f1a356a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.438697 Sep 05 15:02:40.667777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1679/3493] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:40 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:40.668011 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1815/3494] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:41.689465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:41.690052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:41.690468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:41.690574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:41.697211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:41.697439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:41.697691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:41.697922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:41.698126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:41.698356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:41.698837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:41.699071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:41.699293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:41.699528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:41.699708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:41.699953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:41.897227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:41.900344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:41.905428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2fd38994-ea23-4f5f-b32a-606505aff6d3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219399 Sep 05 15:02:41.906081 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1816/3495] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:41 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:41.908846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cadb4121-dbc5-4d8d-8809-0cb6ea74a2db tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.223208 Sep 05 15:02:41.909403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1680/3496] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:41 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:42.928840 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:42.929381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:42.934300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:42.935017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:42.935786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:42.936265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:42.936696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:42.937375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:42.937823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:42.938243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:42.941556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:42.942045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:42.942476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:42.943207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:42.943661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:42.944080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:43.130069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:43.133295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:43.138475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fb3885c4-b845-4aa1-add0-cc8abc6f7710 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213630 Sep 05 15:02:43.146875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1817/3497] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:42 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:43.147006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bcf13a47-62ca-413f-80c5-ffca2f7ca0ec tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210695 Sep 05 15:02:43.147006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1681/3498] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:42 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:44.161711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:44.162932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:44.163729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:44.164334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:44.169767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:44.170253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:44.170860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:44.171580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:44.171704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:44.172042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:44.172179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:44.172461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:44.172609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:44.173201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:44.173644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:44.174498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:44.369192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:44.373439 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:44.377744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-85109ebe-0780-487f-b25f-72b8eaa1a59a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218288 Sep 05 15:02:44.378330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1682/3499] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:44 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:44.381734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-51e733e2-b151-4b76-8361-e3ef902ca3c3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.224031 Sep 05 15:02:44.382299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1818/3500] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:44 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:45.400840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:45.401385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:45.405153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:45.405760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:45.407855 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:45.408336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:45.408766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:45.409467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:45.409914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:45.410329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:45.412075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:45.412572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:45.413002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:45.413684 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:45.414140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:45.414560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:45.596778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:45.603822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:45.606092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e944278f-7dbc-4f37-b1f2-aa148ea19811 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209179 Sep 05 15:02:45.606666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1683/3501] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:45 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:45.612166 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ba4b83b-d34d-464e-a8c2-0d5e98736326 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.210842 Sep 05 15:02:45.612720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1819/3502] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:45 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:46.629529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:46.631334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:46.637267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:46.637879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:46.638044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:46.638403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:46.638863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:46.639740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:46.640194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:46.640615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:46.644785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:46.645287 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:46.645721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:46.647073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:46.647527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:46.647946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:46.840677 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:46.844129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:46.850375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c9f50160-9690-4aeb-8bce-ad9a25008324 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.224415 Sep 05 15:02:46.853108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2fdae44c-0480-4306-b405-c767e890d212 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220674 Sep 05 15:02:46.853659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1820/3503] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:46.863117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1684/3504] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:46 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:47.873628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:47.874266 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:47.875870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:47.876487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:47.880657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:47.881134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:47.881594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:47.882272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:47.882719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:47.882919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:47.883218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:47.883427 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:47.883872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:47.884566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:47.885023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:47.885452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:48.071527 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:48.078257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:48.084494 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-529545f5-bd59-4720-9940-53236f19825a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214895 Sep 05 15:02:48.085164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1821/3505] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:47 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:48.086379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ba8adc3c-d9d1-49df-852e-33f2f0bd8657 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.214339 Sep 05 15:02:48.087131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1685/3506] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:47 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:49.108451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:49.109059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:49.109250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:49.109866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:49.115953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:49.116432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:49.116882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:49.117018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:49.117419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:49.117552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:49.117861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:49.118020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:49.118400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:49.118581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:49.119061 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:49.119489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:49.313485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:49.321888 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a3e6f34e-8183-409c-860b-94511391f700 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217313 Sep 05 15:02:49.324769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1822/3507] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:49 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:49.328238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:49.336819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6193a297-c88a-4a50-b7b1-a3176159c2cc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.231360 Sep 05 15:02:49.337380 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1686/3508] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:50.344656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:50.345267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:50.351743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:50.352162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:50.352593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:50.353275 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:50.353724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:50.354163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:50.359651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:50.360255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:50.367208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:50.367684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:50.368114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:50.368827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:50.369276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:50.369694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:50.545060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:50.553979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f7cbb393-e920-4030-8c6a-b54d5d25af64 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.212541 Sep 05 15:02:50.554361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1823/3509] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:50 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:50.556304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:50.558482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:50.565439 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb7982fb-8a2b-4097-95e1-d7c972ffe319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209624 Sep 05 15:02:50.565981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1687/3510] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:51.577537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:51.578146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:51.585270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:51.585760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:51.586193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:51.586906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:51.587364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:51.587787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:51.590724 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:51.591372 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:51.597893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:51.598374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:51.598875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:51.599527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:51.599977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:51.600398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:51.784218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:51.787629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:51.792576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c4a20aa-c401-4913-ac16-dc737aa9a403 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218915 Sep 05 15:02:51.793478 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1824/3511] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:51 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:51.795711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3730411d-4ab0-4e55-967c-276549eeddea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209182 Sep 05 15:02:51.796413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1688/3512] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:51 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:52.815679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:52.816286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:52.817242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:52.817869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:52.822683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:52.823224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:52.823661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:52.824029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:52.824339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:52.824509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:52.824784 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:52.824945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:52.825198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:52.825632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:52.826086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:52.826513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:53.013146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:53.019975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:53.021362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-21ec182c-84fd-4799-942e-a9953d26d43d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.207895 Sep 05 15:02:53.022030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1689/3513] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:52 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:53.028063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b504d754-258e-4405-b0dd-30577e03be1f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216419 Sep 05 15:02:53.028623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1825/3514] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:52 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:54.044708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:54.045386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:54.050997 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:54.051644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:54.051825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:54.052252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:54.052688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:54.053374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:54.053826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:54.054245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:54.057919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:54.058405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:54.058865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:54.059559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:54.060010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:54.060433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:54.253235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:54.262084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-22697c3a-9167-425a-80a0-ab4778acaae5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.221250 Sep 05 15:02:54.262650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1690/3515] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:54 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:54.268095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:54.276425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e6ba1642-643f-4693-8998-5e916be83042 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.229291 Sep 05 15:02:54.276983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1826/3516] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:54 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:55.284926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:55.285550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:55.292155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:55.292675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:55.293114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:55.294021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:55.294251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:55.294676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:55.298971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:55.299587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:55.305850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:55.306330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:55.306808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:55.307506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:55.307957 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:55.308379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:55.474886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:55.482996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d1fddf20-4e3d-4da9-870d-891f16cc12bd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.201883 Sep 05 15:02:55.483772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1691/3517] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:55 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:55.496102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:55.504212 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-adae2c0f-819e-448c-b82f-de411b76765a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.209144 Sep 05 15:02:55.504778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1827/3518] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:55 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:56.505621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:56.506353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:56.513226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:56.513697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:56.514166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:56.514875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:56.515329 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:56.515751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:56.527412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:56.528020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:56.534252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:56.534732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:56.535197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:56.535880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:56.536332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:56.536749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:56.713625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:56.720480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:56.721704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-99194fc8-e693-4140-bb6b-1c1bf7b23b7b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.219896 Sep 05 15:02:56.722282 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1692/3519] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:56 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:56.728855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bdee4e31-ec7f-41b6-a319-44801c5d01bd tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.205246 Sep 05 15:02:56.729416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1828/3520] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:56 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:57.744671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:57.746997 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:57.751549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:57.752131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:57.752303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:57.752610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:57.753045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:57.753731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:57.754203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:57.754607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:57.759227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:57.759712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:57.760157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:57.760855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:57.761345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:57.761775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:57.946576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:57.950617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:57.955066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0ff722a-5e63-4e5d-8e77-b0360904bd9b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.214266 Sep 05 15:02:57.955637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1693/3521] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:57 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:02:57.958547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-470a6bc1-1da5-4312-95c1-0a04b31a6bba tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.210760 Sep 05 15:02:57.959157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1829/3522] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:57 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:58.978507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:58.979131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:58.981588 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:02:58.982207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:02:58.985535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:58.986016 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:58.986453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:58.987168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:58.987622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:58.988045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:58.988482 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:58.988975 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:58.989416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:58.990104 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:02:58.990567 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:02:58.991024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:02:59.182317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:59.184538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:02:59.187174 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:02:59.191985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce084d7b-e242-475f-84a2-ea65ec9f6d2d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214115 Sep 05 15:02:59.196029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1830/3523] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:58 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:02:59.197085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4aaf7f7a-1487-45c8-82c0-ce9e99f294a5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.222923 Sep 05 15:02:59.197648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1694/3524] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:02:58 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:00.215743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:00.217316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:00.220623 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:00.221958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:00.225010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:00.225581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:00.226152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:00.227161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:00.227618 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:00.228039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:00.230306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:00.231156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:00.231590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:00.232276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:00.232720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:00.233136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:00.421812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:00.428510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:00.430198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dcb3ac8c-9f1e-4d8b-8ccd-1329534b6d0d tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.218542 Sep 05 15:03:00.430845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1831/3525] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:00 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:00.437082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7f8ce849-de89-4627-9061-45b563224426 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.220484 Sep 05 15:03:00.437799 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1695/3526] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:00 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:01.453475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:01.455892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:01.459914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:01.460526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:01.462590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:01.463138 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:01.463620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:01.464270 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:01.464730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:01.465149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:01.467094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:01.468875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:01.468875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:01.468875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:01.469213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:01.469490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:01.658694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:01.662513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:01.667464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-07f24017-5ee5-4eea-bb50-00466f02e97a tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217817 Sep 05 15:03:01.668037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1832/3527] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:01 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:01.671521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e3247e2d-3712-4813-893e-a2056eeffd06 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215002 Sep 05 15:03:01.672086 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1696/3528] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:01 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:02.689822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:02.690444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:02.694697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:02.695992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:02.697816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:02.698380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:02.698838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:02.699580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:02.700047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:02.700469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:02.702362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:02.702866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:02.703306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:02.703992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:02.704438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:02.704860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:02.889050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:02.895741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:02.897192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f1b21659-e394-4f2a-abc4-d835c5fcbef8 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211453 Sep 05 15:03:02.897770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1833/3529] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:02 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:02.904029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2b72b17-5e81-47f3-820c-c0a92c17992f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.213087 Sep 05 15:03:02.904581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1697/3530] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:02 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:03.920076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:03.920649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:03.927051 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:03.927505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:03.927666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:03.927798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:03.928098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:03.928787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:03.929241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:03.930191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:03.934389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:03.934896 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:03.935325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:03.936002 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:03.936474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:03.936891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:04.121699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:04.126025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:04.129979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c1d7c7e3-5eb4-4fb7-a386-b2b9e77802fe tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213845 Sep 05 15:03:04.130556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1834/3531] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:03 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:04.134817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c94ff632-5181-4a8e-8f5d-3706f2e271e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.211471 Sep 05 15:03:04.135811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1698/3532] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:03 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:05.154292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:05.154931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:05.157821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:05.158437 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:05.161367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:05.161846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:05.162325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:05.163035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:05.163485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:05.163955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:05.164752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:05.165269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:05.165703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:05.166389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:05.166864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:05.167288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:05.357645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:05.361589 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:05.366596 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ea8f9c7a-6fef-4d5d-86d6-f04e351bb16f tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216196 Sep 05 15:03:05.367704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1835/3533] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:05 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:05.370741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4c1f3103-5b2c-439d-9998-745a14c8cdbe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216587 Sep 05 15:03:05.371339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1699/3534] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:05 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:06.390553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:06.391232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:06.393337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:06.393969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:06.398674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:06.399205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:06.399648 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:06.400348 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:06.400809 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:06.401252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:06.401373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:06.401824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:06.402270 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:06.402996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:06.403453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:06.403879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:06.591096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:06.595205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:06.599406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d0f0d6f9-ed1e-434a-a2e0-306cc7f64145 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209960 Sep 05 15:03:06.599979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1700/3535] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:06 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:06.604090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-87a68aa7-7320-4e98-8306-4904025905c7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217844 Sep 05 15:03:06.604643 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1836/3536] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:06 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:07.624071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:07.624628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:07.627936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:07.628546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:07.631560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:07.632050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:07.633179 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:07.633880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:07.634339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:07.634768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:07.635459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:07.635938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:07.636369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:07.637052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:07.637500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:07.637918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:07.830847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:07.834112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:07.839001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-80f5baf7-1592-4456-b6c2-1a4d8068fcc5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214843 Sep 05 15:03:07.839561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1837/3537] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:07 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:07.842274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-34d17383-75b4-41d2-8852-944d44541f40 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.222526 Sep 05 15:03:07.842852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1701/3538] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:07 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:08.862073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:08.862690 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:08.864777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:08.865276 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=50 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:08.865405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:08.867650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=52 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:08.869990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:08.870722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:08.871243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:08.871928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:08.872376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:08.872503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:08.872791 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:08.872912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:08.873337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:08.874015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:08.874456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:08.874897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:09.064329 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:09.068619 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:09.073145 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c1bc2212-2276-4f30-acf2-ad5263de9ee5 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.214971 Sep 05 15:03:09.073922 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1838/3539] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:08 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:09.078065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-464c49d2-8b31-4004-a08d-87fb5b315472 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.217027 Sep 05 15:03:09.078823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1702/3540] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:08 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:10.097085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:10.097710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:10.101189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:10.101846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:10.104290 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:10.104782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:10.105222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:10.105917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:10.106383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:10.106829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:10.108718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:10.109193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:10.109621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:10.110302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:10.110749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:10.111191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:10.296903 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:10.303721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:10.305710 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6484461d-2d8e-4cd0-9c9d-1edcf14979b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.213208 Sep 05 15:03:10.306282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1839/3541] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:10 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:10.312487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-661521d8-1864-4549-8dd9-f3d85ad39db0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.215503 Sep 05 15:03:10.313056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1703/3542] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:10 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:11.328738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:11.329353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:11.335041 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:11.336164 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:11.336319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:11.336789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:11.337226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:11.337913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:11.338405 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:11.338847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:11.342517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:11.343050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:11.343476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:11.344163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:11.344615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:11.345089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:11.360084 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=100 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:11.528293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:11.532180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:11.536561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-aafbadab-0678-46ab-b078-fff1588c41a6 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.211700 Sep 05 15:03:11.537139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1840/3543] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:11 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:11.540910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0cb3e46e-e165-40bc-97d6-6667f672dd37 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.209814 Sep 05 15:03:11.541457 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1704/3544] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:11 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:12.560962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:12.561742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:12.563614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:12.564221 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:12.568357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:12.568836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:12.569378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:12.569960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:12.570409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:12.570752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:12.570887 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:12.571269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:12.571698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:12.572379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:12.572827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:12.573245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:12.765040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:12.768293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:12.773364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c03b333c-8ba3-4891-bdb2-6719de8d09b1 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.216592 Sep 05 15:03:12.774160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1841/3545] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:12 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:12.776383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7e9ee25a-bb74-4586-bc65-4ee08e51a3c0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216910 Sep 05 15:03:12.776940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1705/3546] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:12 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:13.795989 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:13.796601 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] [instance: a50e765d-9688-493d-ac8c-fd4bf3bb5580] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:13.801087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:13.801784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:13.803031 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:13.803512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:13.803943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:13.805111 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:13.805565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:13.805978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:13.808108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:13.808590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:13.809018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:13.809698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:13.810181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:13.810602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:14.001278 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1a2d7c64ad9d44f997333ace9d4e60a1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e17efecb1ba44e69ac6b076e56ec9603', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:14.005253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:14.009375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-afde4296-4d00-4350-8898-cdac56b8e789 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580" status: 200 len: 1600 microversion: 2.1 time: 0.217188 Sep 05 15:03:14.009943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1842/3547] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:13 2022] GET /compute/v2.1/servers/a50e765d-9688-493d-ac8c-fd4bf3bb5580 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:14.013610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-81a6cf9d-d57f-4deb-84eb-998d979e651d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.216727 Sep 05 15:03:14.014246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1706/3548] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:13 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:14.031040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b43fed41-cca7-4175-a9a7-d161d833caf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] Calling method '.version_select at 0x7fb194bb6af0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:14.097114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b43fed41-cca7-4175-a9a7-d161d833caf7 tempest-TestMinimumBasicScenario-1151958227 tempest-TestMinimumBasicScenario-1151958227-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1349983520" status: 202 len: 0 microversion: 2.1 time: 0.069626 Sep 05 15:03:14.097761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1843/3549] 10.222.0.15 () {58 vars in 1272 bytes} [Mon Sep 5 15:03:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1349983520 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 05 15:03:15.036400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:15.037093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:15.043625 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:15.044105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:15.044542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:15.045224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:15.045673 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:15.046096 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:15.175765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:15.184582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-02898f80-ab8b-43b4-82f8-d6d5dc12cf6a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152079 Sep 05 15:03:15.185138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1707/3550] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:15 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:16.208974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:16.209590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:16.216054 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:16.216572 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:16.217008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:16.217705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:16.218154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:16.218571 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:16.436005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:16.444297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bd9762f9-5dc0-43b0-963c-4f7933d6a784 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.239841 Sep 05 15:03:16.444863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1844/3551] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:16 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:17.467517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:17.468674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:17.476137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:17.476795 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:17.477295 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:17.478066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:17.479027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:17.479653 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:17.635059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:17.644349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1f60605d-c7ee-44c3-aefb-2b66a88f6319 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.180836 Sep 05 15:03:17.645919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1708/3552] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:17 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:18.236819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-bd47bb44-714e-4e44-b06a-a08f7fb9eec8 req-b963b6f1-8122-4131-88e3-ea04918f71cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dc3d4fd-7509-404c-af29-824137cd6af4", "name": "network-vif-deleted", "tag": "a7a3ce21-401c-48a5-92c3-c6b190a86ba7"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:03:18.249309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-bd47bb44-714e-4e44-b06a-a08f7fb9eec8 req-b963b6f1-8122-4131-88e3-ea04918f71cf service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:18.249979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-bd47bb44-714e-4e44-b06a-a08f7fb9eec8 req-b963b6f1-8122-4131-88e3-ea04918f71cf service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:18.250412 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-bd47bb44-714e-4e44-b06a-a08f7fb9eec8 req-b963b6f1-8122-4131-88e3-ea04918f71cf service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:18.262134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-bd47bb44-714e-4e44-b06a-a08f7fb9eec8 req-b963b6f1-8122-4131-88e3-ea04918f71cf service nova] Creating event network-vif-deleted:a7a3ce21-401c-48a5-92c3-c6b190a86ba7 for instance 6dc3d4fd-7509-404c-af29-824137cd6af4 on hv-cinder-84290 Sep 05 15:03:18.267732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-bd47bb44-714e-4e44-b06a-a08f7fb9eec8 req-b963b6f1-8122-4131-88e3-ea04918f71cf service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034820 Sep 05 15:03:18.268319 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1845/3553] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:03:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:03:18.669251 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:18.669854 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:18.676606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:18.677089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:18.677573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:18.678211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:18.678658 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:18.679105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:18.828163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:18.837307 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb7a36f5-8073-4465-8b40-3561a1863083 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.171233 Sep 05 15:03:18.838203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1709/3554] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:18 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:19.861979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:19.862671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:19.869712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:19.870183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:19.870892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:19.871568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:19.872366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:19.872790 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:19.999934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:20.009459 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f7f00490-a3e5-4b04-9857-acd7220b89fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151703 Sep 05 15:03:20.010012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1846/3555] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:19 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:21.033220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:21.033835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:21.040272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:21.040753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:21.041189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:21.041874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:21.042330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:21.042762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:21.174600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:21.183277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ae64d3fa-4cb6-4f23-9493-8978e5f76b80 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153943 Sep 05 15:03:21.183842 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1710/3556] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:21 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:22.207137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:22.207746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:22.214708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:22.215221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:22.215652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:22.216345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:22.216777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:22.217196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:22.343661 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:22.351767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-846f2046-70b9-4f53-affc-0f9d6682da91 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148466 Sep 05 15:03:22.352302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1847/3557] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:22 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:23.375066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:23.375646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:23.382493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:23.383018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:23.383458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:23.384141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:23.384597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:23.385018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:23.510064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:23.518118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06a64d66-7778-4c77-a061-a66974cd83e6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147312 Sep 05 15:03:23.518675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1711/3558] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:23 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:24.542415 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:24.543046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:24.549457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:24.549932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:24.550363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:24.551073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:24.551522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:24.551938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:24.682944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:24.691163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a1e719fb-2726-40ba-94f4-86d489408604 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153043 Sep 05 15:03:24.691725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1848/3559] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:24 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:25.714075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:25.714676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:25.721018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:25.721487 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:25.721910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:25.722582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:25.723049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:25.723473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:25.849597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:25.857608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2a15beea-dbc9-4f80-870d-122ec6daa940 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147497 Sep 05 15:03:25.858167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1712/3560] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:25 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:26.881272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:26.881881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:26.888324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:26.888802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:26.889237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:26.889918 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:26.890368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:26.890811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:26.893399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=100 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:27.022214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:27.030355 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-66d76ca7-6555-42c1-ba85-243db0c5fbf8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152996 Sep 05 15:03:27.030940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1849/3561] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:26 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:28.053667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:28.054273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:28.061273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:28.061744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:28.062172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:28.062875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:28.063323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:28.063738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:28.191284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:28.199378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bf2eaf27-0d0d-4c07-be57-f53773b50970 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149568 Sep 05 15:03:28.199938 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1713/3562] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:28 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:29.222221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:29.222852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:29.229391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:29.229871 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:29.230298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:29.231009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:29.231481 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:29.231900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:29.356865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:29.365929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-79bb97d9-77e1-435e-8824-3261613a3645 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148352 Sep 05 15:03:29.366491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1850/3563] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:29 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:30.389781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:30.390340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:30.396725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:30.397202 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:30.397636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:30.398316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:30.398768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:30.399213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:30.531039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:30.539162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9f9c4764-417e-454c-b0a5-a598cf354be1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153376 Sep 05 15:03:30.539756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1714/3564] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:30 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:31.561297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:31.561981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:31.568500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:31.568976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:31.569416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:31.570099 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:31.570554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:31.571010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:31.697491 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:31.706126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f429baae-8efb-4397-b048-1bf6bba2a0ce tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148721 Sep 05 15:03:31.706646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1851/3565] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:31 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:32.729494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:32.730160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:32.732178 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:03:32.732421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:03:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 (ip 10.222.0.15) !!! Sep 05 15:03:32.739324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:32.739800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:32.740233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:32.740967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:32.741404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:32.741823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:32.873173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:32.881240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b7824d12-540a-42af-b3b5-2a350f79ee19 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.155661 Sep 05 15:03:32.881805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1715/3566] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:32 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:33.904224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:33.904772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:33.911262 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:33.911745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:33.912192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:33.912847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:33.913296 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:33.913717 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:34.041902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:34.050109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3116c657-4e34-4a5d-8817-0a76213f16a1 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149843 Sep 05 15:03:34.050676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1852/3567] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:33 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:35.073947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:35.074626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:35.081302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:35.081801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:35.082261 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:35.083003 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:35.083451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:35.083868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:35.213738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:35.221856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-513d2132-5bc7-4c97-94dc-78b76097e9d4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152353 Sep 05 15:03:35.222412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1716/3568] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:36.245063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:36.245949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:36.252547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:36.253021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:36.253453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:36.254129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:36.254575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:36.255023 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:36.382028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:36.390615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-33d2d908-ad0b-42fd-a761-907b3055c7b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149406 Sep 05 15:03:36.391244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1853/3569] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:37.414497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:37.415064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:37.421907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:37.422388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:37.422869 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:37.423547 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:37.424037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:37.424442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:37.551449 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:37.559614 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b0aeaa7e-50c5-4cc4-a291-0edf3b8ac36f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149078 Sep 05 15:03:37.560168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1717/3570] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:37 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:38.582502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:38.583179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:38.590399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:38.590908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:38.591349 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:38.592034 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:38.592489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:38.592944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:38.722179 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:38.730318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6933b270-9d2a-4a0c-8bee-b33d581dcb57 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151662 Sep 05 15:03:38.730906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1854/3571] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:38 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:39.753215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:39.753824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:39.756205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=32 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:39.760870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:39.761342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:39.761770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:39.762450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:39.762919 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:39.763337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:39.889608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:39.897627 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a0ebdf61-b710-471d-8961-cb71d10c04b9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148249 Sep 05 15:03:39.898189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1718/3572] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:39 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:40.921220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:40.921831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:40.924241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=35,nova_api:DELETE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:40.928852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:40.929332 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:40.929766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:40.930445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:40.930920 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:40.932005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:41.061229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:41.069185 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-851070cb-3583-4c4b-9e8a-1a5287735a2d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151833 Sep 05 15:03:41.069744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1855/3573] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:42.092007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:42.092613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:42.099215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:42.099700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:42.100139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:42.100830 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:42.101286 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:42.101709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:42.104274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=88 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:42.265624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:42.274004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9918f142-d0d7-4b9b-8981-ed36d6e19eb4 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.185893 Sep 05 15:03:42.274628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1719/3574] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:42 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:43.296464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:43.297072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:43.303517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:43.303991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:43.304419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:43.305091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:43.305536 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:43.305949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:43.437201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:43.445175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1a1d7556-df7f-449a-b297-63207f18d421 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152610 Sep 05 15:03:43.445727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1856/3575] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:43 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:44.468119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:44.468857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:44.474845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:44.475397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:44.475828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:44.476527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:44.476974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:44.477389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:44.606305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:44.614276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9f0fa3ce-0cf5-4735-97e9-4e1679a29a22 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150349 Sep 05 15:03:44.614845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1720/3576] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:44 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:45.638291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:45.638929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:45.645426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:45.645906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:45.646343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:45.647064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:45.647521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:45.647948 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:45.778611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:45.786767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-08135a38-a7db-42a4-b6e9-40164b8b210a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152920 Sep 05 15:03:45.787345 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1857/3577] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:45 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:46.809522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:46.810081 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:46.816496 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:46.816971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:46.817401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:46.818079 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:46.818528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:46.818990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:46.946029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:46.954584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-859db8c6-469a-4fc1-b4cd-50544f4b336d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149000 Sep 05 15:03:46.955163 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1721/3578] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:47.978097 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:47.979269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:47.985454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:47.985934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:47.986366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:47.987072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:47.987528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:47.987950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:48.115163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:48.123564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-95dbde44-f582-4150-b50e-7a492f808eb8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149376 Sep 05 15:03:48.124130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1858/3579] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:47 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:49.145498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:49.146129 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:49.152575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:49.153049 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:49.153478 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:49.154156 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:49.154602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:49.155046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:49.285943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:49.294575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-075dc60e-5a8e-465d-9a8e-f0930fdee35b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153091 Sep 05 15:03:49.295177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1722/3580] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:50.317720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:50.318327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:50.325579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:50.326066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:50.326508 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:50.327218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:50.327680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:50.328102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:50.456199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:50.464303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-89f3dfb3-9774-491d-9c68-98c872013d28 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150433 Sep 05 15:03:50.464873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1859/3581] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:51.486910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:51.487518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:51.493945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:51.494353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:51.494780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:51.495476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:51.496172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:51.496595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:51.625613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:51.633644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-78b831c7-b074-4e45-9de2-8d3281a8392b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150566 Sep 05 15:03:51.634196 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1723/3582] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:51 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:52.656449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:52.657758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:52.664374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:52.664952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:52.665385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:52.666067 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:52.667153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:52.667577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:52.795893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:52.803858 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4e281de-28c0-47f3-b79f-5f6b9171a763 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151265 Sep 05 15:03:52.804429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1860/3583] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:52 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:53.825739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:53.826333 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:53.832682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:53.833155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:53.833583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:53.834257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:53.834702 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:53.835144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:53.960025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:53.968028 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2232bc85-4e4f-4eee-941e-beb0caf49c54 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.146187 Sep 05 15:03:53.968593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1724/3584] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:53 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:03:54.991204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:54.991812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:54.999069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:54.999550 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:54.999979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:55.000752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:55.001201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:55.001620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:55.130523 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:55.139335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ab9138c-2765-4b65-9c3c-8263c78d619b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152014 Sep 05 15:03:55.139916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1861/3585] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:54 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:56.162718 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:56.163363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:56.169752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:56.170237 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:56.170691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:56.171418 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:56.171875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:56.172302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:56.297489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:56.305630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cfbb6dfe-251c-44aa-bfa2-782a609164d5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.146836 Sep 05 15:03:56.306198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1725/3586] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:56 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:57.328951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:57.329565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:57.336052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:57.336537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:57.336974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:57.337656 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:57.338607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:57.339061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:57.342899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=78 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:03:57.471007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:57.479237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2bc5b192-d7ae-4ab1-967c-ec1309b6ca7e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.154116 Sep 05 15:03:57.479807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1862/3587] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:57 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:58.501760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:58.502371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:58.508822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:58.509298 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:58.509729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:58.510416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:58.510898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:58.511325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:58.636562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:58.644759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fb5b5fd3-75a8-4ccb-9784-205f57b82c56 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.146968 Sep 05 15:03:58.645319 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1726/3588] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:58 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:03:59.668231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:03:59.668861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:03:59.675317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:59.675802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:59.676244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:59.676925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:03:59.677380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:03:59.677802 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:03:59.804996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:03:59.813154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6b01bceb-e7c5-49cf-927a-d7649e4114e3 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149407 Sep 05 15:03:59.813727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1863/3589] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:03:59 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:00.835946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:00.836530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:00.843535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:00.844017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:00.844452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:00.845133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:00.845588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:00.846008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:00.976211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:00.984881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f677e276-0152-426c-a933-ed20e788f546 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152828 Sep 05 15:04:00.985450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1727/3590] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:00 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:02.008070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:02.008704 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:02.015679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:02.016160 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:02.016586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:02.017286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:02.017734 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:02.018147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:02.145051 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:02.153712 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0feaf4ca-1792-4101-afb5-6ed25dc93658 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149607 Sep 05 15:04:02.154267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1864/3591] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:02 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:03.182320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:03.183022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:03.189220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:03.189694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:03.190128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:03.190805 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:03.191267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:03.191686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:03.320194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:03.328692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4a0bb928-a19d-45d5-92d5-935016446c69 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150233 Sep 05 15:04:03.329245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1728/3592] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:03 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:04.351326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:04.351870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:04.358136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:04.358612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:04.359069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:04.359779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:04.360227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:04.360645 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:04.486877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:04.495423 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3d76b68e-c7b5-48b0-8e78-0dfa92aded78 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147556 Sep 05 15:04:04.495977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1865/3593] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:04 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:05.519252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:05.519868 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:05.526879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:05.527362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:05.527796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:05.528475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:05.528929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:05.529349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:05.657945 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:05.666045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e6afd1c3-736a-450e-a823-b59febeebdcb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150675 Sep 05 15:04:05.666611 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1729/3594] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:05 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:06.689789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:06.690427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:06.696924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:06.697404 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:06.697833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:06.698510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:06.698990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:06.699406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:06.826996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:06.835217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d5c5188-a802-4a5e-b859-7cb41a48a1be tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149219 Sep 05 15:04:06.835787 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1866/3595] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:06 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:07.859364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:07.859966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:07.866400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:07.866911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:07.867353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:07.868040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:07.868494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:07.868925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:07.995654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:08.004170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-96981a53-4acc-46d8-8123-c93ba5b1d0bc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149072 Sep 05 15:04:08.004731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1730/3596] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:07 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:09.027968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:09.028577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:09.035005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:09.035487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:09.035923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:09.036604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:09.037056 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:09.037475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:09.167526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:09.175544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2eec4dd3-6b32-4fba-af2a-bb9d076d9312 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152130 Sep 05 15:04:09.176110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1867/3597] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:09 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:10.199106 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:10.199712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:10.202042 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=26 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:10.206635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:10.207147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:10.207579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:10.208253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:10.208697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:10.209117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:10.335396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:10.343365 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-512eac63-950a-4ef8-8606-63d642231ec2 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148782 Sep 05 15:04:10.343922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1731/3598] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:10 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:11.366033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:11.366663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:11.368936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=26 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:11.373875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:11.374353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:11.374797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:11.375522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:11.375973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:11.376398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:11.504748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:11.513402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-24c70cfb-2ac0-4b5b-b4f4-a634c307ee63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151346 Sep 05 15:04:11.513961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1868/3599] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:11 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:12.537715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:12.538309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:12.545481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:12.545959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:12.546392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:12.547111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:12.547565 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:12.547986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:12.550516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=78 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:12.675713 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:12.683823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-788d3490-3537-4e30-961e-a048fe24b880 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149964 Sep 05 15:04:12.684389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1732/3600] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:12 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:13.709458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:13.710071 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:13.716585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:13.717079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:13.717493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:13.718173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:13.718621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:13.719065 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:13.915165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:13.923969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-56e6c308-2edb-47fb-a27d-3df44ba066c5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.218426 Sep 05 15:04:13.924530 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1869/3601] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:13 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:14.946396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:14.947038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:14.953651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:14.954131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:14.954568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:14.955314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:14.955742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:14.956166 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:15.087735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:15.096504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b1fb8bdf-d3cb-477d-ae43-2dd67fbd702d tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153511 Sep 05 15:04:15.096504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1733/3602] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:14 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:16.119472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:16.120078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:16.126331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:16.126803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:16.127357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:16.128033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:16.128509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:16.128924 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:16.255191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:16.263803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-14f2ad2d-a3b7-440e-8eb6-033610099b3f tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148255 Sep 05 15:04:16.264354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1870/3603] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:16 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:17.286722 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:17.287318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:17.294490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:17.295001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:17.295431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:17.296108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:17.296549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:17.296965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:17.657325 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:17.665408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b6f0ef5f-0d24-4b33-9f8c-0d52eea5d655 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.382587 Sep 05 15:04:17.665971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1734/3604] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:17 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:18.689321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:18.689936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:18.696389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:18.696869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:18.697334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:18.698664 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:18.699157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:18.699586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:18.825408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:18.833654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d620163d-ffb1-400c-b7b5-9d41c5f30dcc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148259 Sep 05 15:04:18.834217 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1871/3605] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:18 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:19.856906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:19.857444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:19.863922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:19.864403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:19.864839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:19.865520 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:19.865971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:19.866390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:19.994946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:20.003356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9d1357d7-cb5e-4347-96ff-f8c93e5fd043 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150940 Sep 05 15:04:20.003921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1735/3606] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:19 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:21.025575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:21.026190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:21.032737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:21.033218 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:21.033654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:21.034340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:21.034818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:21.035243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:21.162012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:21.170921 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9927e0ff-b465-450c-8197-9cb393993953 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149270 Sep 05 15:04:21.171658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1872/3607] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:21 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:22.194507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:22.195147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:22.202348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:22.202963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:22.203443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:22.204147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:22.204603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:22.205026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:22.330503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:22.338553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5162cc45-6ccd-417a-ab26-1b9bf879e317 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148105 Sep 05 15:04:22.339143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1736/3608] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:22 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:23.361350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:23.361892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:23.368548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:23.369026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:23.369453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:23.370828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:23.371310 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:23.371987 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:23.500770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:23.508720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bf3b5c9b-dc62-4fbf-aabe-4edea1bb679a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151356 Sep 05 15:04:23.509273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1873/3609] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:23 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:24.531147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:24.531753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:24.538101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:24.538575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:24.539044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:24.539720 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:24.540165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:24.540580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:24.667216 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:24.675396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0426825d-66f9-4597-ad13-c9df86bc4d82 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148173 Sep 05 15:04:24.675960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1737/3610] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:24 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:25.698165 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:25.698879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:25.705243 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:25.705721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:25.706154 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:25.706866 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:25.707326 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:25.707745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:25.838237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:25.846417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-50bec5b3-bfe7-4cd8-b10b-472408fb4260 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152181 Sep 05 15:04:25.847008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1874/3611] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:25 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:26.870399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:26.871033 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:26.877706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:26.878176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:26.878631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:26.879334 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:26.879780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:26.880199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:27.006682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:27.015516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-98a8c4c0-0105-4fdd-bef2-a244c32005ff tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148924 Sep 05 15:04:27.016087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1738/3612] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:26 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:28.039383 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:28.039990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:28.046529 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:28.047021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:28.047451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:28.048126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:28.048573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:28.048988 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:28.052805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=78 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:28.181062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:28.189702 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-949a8e3d-38f9-4dd4-aedb-246b676fb215 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.154225 Sep 05 15:04:28.190274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1875/3613] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:28 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:29.213278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:29.213895 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:29.220906 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:29.221388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:29.221823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:29.222510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:29.223001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:29.223429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:29.352402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:29.360570 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-013fb2ec-faa0-41b0-b638-81d9e840cedc tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151227 Sep 05 15:04:29.361135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1739/3614] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:29 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:30.383756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:30.384372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:30.390925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:30.391409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:30.391873 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:30.392558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:30.393016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:30.393440 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:30.520461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:30.529123 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-379246b1-386a-459f-a744-0b2050a92dbd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149251 Sep 05 15:04:30.529696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1876/3615] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:30 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:31.552907 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:31.553525 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:31.559950 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:31.560429 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:31.560863 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:31.561550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:31.562005 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:31.562431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:31.692844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:31.701596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc0e935f-2af1-45dc-82bb-8c34711b0c41 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152620 Sep 05 15:04:31.702153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1740/3616] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:31 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:32.725652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:32.726261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:32.733384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:32.733864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:32.734297 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:32.735021 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:32.735476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:32.735902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:32.862259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:32.870339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6edf8a6c-fe5c-4597-a42c-1d5f30f2fbda tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148696 Sep 05 15:04:32.870925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1877/3617] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:32 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:33.893592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:33.894203 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:33.900692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:33.901171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:33.901609 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:33.902288 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:33.902737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:33.903186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:34.030689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:34.038714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8b34d99d-2a2a-407a-ac18-75f7a8a2d3e7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149127 Sep 05 15:04:34.039312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1741/3618] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:33 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:35.062072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:35.062683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:35.069184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:35.069660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:35.070096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:35.070776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:35.071255 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:35.071683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:35.197916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:35.206485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-476c9e97-96da-4ad8-a6e7-dc13cc194a23 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148253 Sep 05 15:04:35.207078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1878/3619] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:35 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:36.229384 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:36.230120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:36.236545 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:36.237020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:36.237447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:36.238118 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:36.238563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:36.239075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:36.364680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:36.373859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a02511b0-ca52-4c64-bca7-81450dc73bb5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148285 Sep 05 15:04:36.374424 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1742/3620] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:36 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:37.397421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:37.397972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:37.404925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:37.405389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:37.405824 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:37.406504 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:37.406996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:37.407422 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:37.538970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:37.547068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ca85663e-a6ca-416b-87d7-b6bf5608fbfe tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153552 Sep 05 15:04:37.547623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1879/3621] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:37 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:04:38.570301 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:38.570947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:38.577396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:38.577876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:38.578310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:38.579019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:38.579473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:38.579892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:38.706231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:38.714316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f3183db2-c29a-4177-88fd-9358d65b8524 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147912 Sep 05 15:04:38.714911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1743/3622] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:38 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:39.737981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:39.738587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:39.745087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:39.745560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:39.745986 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:39.746660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:39.747393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:39.748425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:39.876455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:39.884460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8c6b0982-e0ff-48b2-8297-80b251e3758a tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150388 Sep 05 15:04:39.885025 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1880/3623] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:39 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:40.907098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:40.907687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:40.910039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=26 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:40.914690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:40.915201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:40.915635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:40.916318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:40.916774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:40.917199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:41.042709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:41.051504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c2f48e4b-f7dd-4ecf-bc51-460d29497dea tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148788 Sep 05 15:04:41.052071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1744/3624] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:40 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:42.074517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:42.075140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:42.077518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=26 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:42.082113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:42.088286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:42.088286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:42.088286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:42.088286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:42.088747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:42.214575 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:42.222762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c42d2a2d-d60a-40f2-b886-343f40940dbb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152101 Sep 05 15:04:42.223919 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1881/3625] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:42 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:43.246811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:43.247688 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:43.254108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:43.254605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:43.255055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:43.255739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:43.256190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:43.256613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:43.260454 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=78 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:43.386516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:43.394616 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6b63e4d5-5f62-4a96-8407-05556e8510cd tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151692 Sep 05 15:04:43.395213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1745/3626] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:43 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:44.418086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:44.418619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:44.425029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:44.425507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:44.425941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:44.426624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:44.427108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:44.427533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:44.553246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:44.561765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-44d2df3e-cbac-412c-99b5-84dad18c6f4b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147623 Sep 05 15:04:44.562330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1882/3627] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:44 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:45.584998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:45.585641 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:45.591821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:45.592782 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:45.593213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:45.593889 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:45.594335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:45.594753 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:45.725012 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:45.733183 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d31d1b52-3f16-4f39-9c7c-105e0f1b1cb6 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152111 Sep 05 15:04:45.733744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1746/3628] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:45 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:46.756531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:46.757129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:46.763208 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:46.763686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:46.764124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:46.764801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:46.765249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:46.765670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:46.892487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:46.900614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fc675aae-75c0-46fb-aaa6-1c10e42a9049 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.148107 Sep 05 15:04:46.901183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1883/3629] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:46 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:47.925207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:47.925820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:47.932176 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:47.932654 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:47.933089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:47.933773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:47.934226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:47.934645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:48.064684 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:48.072787 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e2727065-0f8d-4ec5-b838-1cf643ae0f65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151497 Sep 05 15:04:48.073347 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1747/3630] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:47 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:49.096449 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:49.097066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:49.103534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:49.104010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:49.104443 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:49.105125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:49.105574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:49.105995 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:49.231183 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:49.239198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-57285fad-1d71-400b-9cc4-fe8e4f466f75 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.146597 Sep 05 15:04:49.239756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1884/3631] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:49 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:50.261905 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:50.262501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:50.269777 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:50.273988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:50.273988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:50.273988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:50.273988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:50.274435 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:50.401622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:50.410342 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-738d2538-c4c7-4718-9596-76267ad7d3ee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.152491 Sep 05 15:04:50.410930 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1748/3632] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:50 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:51.433292 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:51.433909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:51.440475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:51.440960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:51.441400 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:51.442091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:51.442548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:51.443014 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:51.568503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:51.576624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f8336eb-1359-4392-888c-6ac82cccced5 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147235 Sep 05 15:04:51.577189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1885/3633] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:51 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:52.600191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:52.600817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:52.607468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:52.608428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:52.608858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:52.609530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:52.609974 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:52.610389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:52.738423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:52.746596 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9f98bd5c-ea87-4a32-ab67-2d7ea676b213 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150353 Sep 05 15:04:52.747468 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1749/3634] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:52 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:53.770394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:53.771076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:53.777500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:53.777993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:53.778431 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:53.779182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:53.780182 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:53.780612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:53.908808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:53.917128 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8a850125-cd73-456c-b4ec-9bcca9d692b7 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150679 Sep 05 15:04:53.917696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1886/3635] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:53 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:54.940007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:54.940613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:54.946960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:54.947431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:54.947856 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:54.948526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:54.948971 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:54.949386 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:55.074297 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:55.083107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f21d4f94-2c64-469e-9cd6-00984941abe8 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147034 Sep 05 15:04:55.083678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1750/3636] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:54 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:56.105782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:56.106387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:56.113376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:56.113844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:56.114271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:56.114979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:56.115429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:56.115844 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:56.254144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:56.262224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9d953f46-6e8a-4573-b43e-d1ab75d02b65 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.160263 Sep 05 15:04:56.262781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1887/3637] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:56 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:57.285168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:57.285774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:57.292349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:57.292828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:57.293263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:57.293943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:57.294396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:57.294846 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:57.422170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:57.430392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-61975384-0bf7-44a1-be92-d6719cb62dc9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149080 Sep 05 15:04:57.430992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1751/3638] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:57 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:58.453611 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:58.454215 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:58.460722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:58.461199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:58.461628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:58.462308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:58.462754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:58.463196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:58.467035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=78 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:04:58.587354 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:58.595384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-166e3727-e896-41a1-bb05-ec5303e93310 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.145844 Sep 05 15:04:58.595956 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1888/3639] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:58 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:04:59.619065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:04:59.619675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:04:59.626314 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:59.626769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:59.627236 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:59.627917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:04:59.628362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:04:59.628781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:04:59.805335 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:04:59.813341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b301c9f0-0f34-4399-a17a-c8471e8355e9 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.198257 Sep 05 15:04:59.813894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1752/3640] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:04:59 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:05:00.835864 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:00.836476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:00.839303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:05:00.839448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:05:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 (ip 10.222.0.15) !!! Sep 05 15:05:00.845586 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:00.846069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:00.846501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:00.847235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:00.847689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:00.848110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:00.980783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:00.989556 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-deb906bc-498a-4a0b-812b-17bd20cb6637 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.157506 Sep 05 15:05:00.990121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1889/3641] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:00 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:02.012790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:02.013415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:02.020597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:02.021073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:02.021507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:02.022188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:02.022644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:02.023101 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:02.153866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:02.161961 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ed6fd544-e546-44cd-8d91-0a99d56fdd63 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.153079 Sep 05 15:05:02.162517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1753/3642] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:02 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:03.184591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:03.185203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:03.191686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:03.192163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:03.192595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:03.193274 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:03.193725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:03.194147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:03.321336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:03.329808 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0481f4b7-0fb8-466e-b60b-bbff3871dd81 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149196 Sep 05 15:05:03.330376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1890/3643] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:03 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:04.353040 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:04.353576 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:04.360755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:04.361232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:04.361663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:04.362340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:04.362814 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:04.363235 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:04.490949 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:04.499411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4de7d1d1-47d5-4eef-ba3a-2af49cdf57e0 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150348 Sep 05 15:05:04.499975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1754/3644] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:04 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:05.522755 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:05.523429 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:05.530502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:05.531020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:05.531458 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:05.532249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:05.532715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:05.533143 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:05.658862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:05.666813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-44eb3b52-8baa-4e08-b9be-9da81b54368e tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147909 Sep 05 15:05:05.667377 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1891/3645] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:05 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:06.690230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:06.690812 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:06.697167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:06.697638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:06.698064 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:06.698751 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:06.699214 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:06.699632 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:06.829056 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:06.837306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2c0899a3-bcea-425e-b7e7-be9f04a04bee tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151675 Sep 05 15:05:06.841533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1755/3646] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:06 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:07.860402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:07.861007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:07.867473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:07.867949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:07.868380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:07.869060 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:07.869514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:07.869936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:07.998007 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:08.006170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-cd604e14-aa3d-47ec-b452-d6cd5ab3e13b tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150227 Sep 05 15:05:08.006730 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1892/3647] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:07 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:09.029116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:09.029757 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:09.036886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:09.037361 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:09.037796 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:09.038474 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:09.038976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:09.039399 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:09.166326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:09.174492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-729b7b90-1f86-4462-9039-eb00414c2455 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149343 Sep 05 15:05:09.175089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1756/3648] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:09 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:10.197135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:10.197742 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:10.204202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:10.204676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:10.205137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:10.205811 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:10.206258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:10.206674 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:10.334592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:10.343198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c1de06ce-3ecb-49be-b7a3-5e6841f4a075 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149359 Sep 05 15:05:10.343762 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1893/3649] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:10 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:11.366321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:11.366926 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:11.369199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=26 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:05:11.374048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:11.377351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:11.377351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:11.377351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:11.377351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:11.377784 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:11.502210 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:11.510278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a84644a4-0af7-4927-904c-a5a5c7e39030 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.147864 Sep 05 15:05:11.510858 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1757/3650] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:11 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:12.533971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:12.534614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:12.536951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=26 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:05:12.541740 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:12.542222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:12.542650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:12.543370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:12.543818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:12.544235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:12.671785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:12.680564 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-82eb048e-e615-4a54-a30a-7a2f009097fb tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.150957 Sep 05 15:05:12.681144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1894/3651] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:12 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:13.704338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:13.704952 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:13.711559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:13.712034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:13.712462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:13.713139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:13.713582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:13.713999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:13.717829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=78 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:05:13.843289 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:13.851392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-76a45ccc-99b0-4b73-aea6-6c1081e37086 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.151003 Sep 05 15:05:13.851951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1758/3652] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:13 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:05:14.875468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:05:14.876057 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] [instance: 04bf5a93-4e3a-4291-afcd-c0213a44d540] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:05:14.882357 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:14.882855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:14.883289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:14.883968 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:05:14.884414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:05:14.884827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:05:15.012666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dac33ec33c26411d9dcf8c3bbea7a9e9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f60d54b7dc874a8080159b81aafc89d5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:05:15.020770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2b118790-996d-40f4-9de6-06bdc8bf1216 tempest-VolumesSnapshotTestJSON-1878134250 tempest-VolumesSnapshotTestJSON-1878134250-project] 10.222.0.15 "GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540" status: 200 len: 1560 microversion: 2.1 time: 0.149994 Sep 05 15:05:15.021338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1895/3653] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:05:14 2022] GET /compute/v2.1/servers/04bf5a93-4e3a-4291-afcd-c0213a44d540 => generated 1560 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:07:18.148408 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:07:18.149019 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:07:18.149687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=5 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:07:18.150640 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:07:18.150833 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe (ip 10.222.0.15) !!! Sep 05 15:07:18.151771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:07:18.152066 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe (ip 10.222.0.15) !!! Sep 05 15:07:18.153733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:07:18.154027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe (ip 10.222.0.15) !!! Sep 05 15:07:18.158108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:07:18.158601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:07:18.166759 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:07:18.167152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:07:18.167591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:07:18.168290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:07:18.168744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:07:18.169172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:07:18.201027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe HTTP/1.1 Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:07:18.203969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.206233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '79f81a66-3708-4a39-976c-ad76174a0cfe'} Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:07:18.207280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.209712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.211993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:07:18.211993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a3637411-5e6f-425d-ba8c-d1db06e6f0db tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 404 len: 111 microversion: 2.1 time: 0.058731 Sep 05 15:07:18.211993 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1759/3654] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:07:18 2022] DELETE /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:07:18.212322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:07:18.212812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:07:18.213468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=47 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:07:18.214235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:07:18.214362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:07:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe (ip 10.222.0.15) !!! Sep 05 15:07:18.221468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:07:18.222082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 79f81a66-3708-4a39-976c-ad76174a0cfe] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:07:18.235675 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:07:18.236147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:07:18.236608 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:07:18.237293 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:07:18.237739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:07:18.238768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:07:18.254657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe HTTP/1.1 Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:07:18.256624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.258609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '79f81a66-3708-4a39-976c-ad76174a0cfe'} Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:07:18.259720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. Sep 05 15:07:18.261448 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:07:18.263558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 79f81a66-3708-4a39-976c-ad76174a0cfe could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:07:18.263558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-25b2dd69-73b1-47b7-b270-0bbeb7703f8d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe" status: 404 len: 111 microversion: 2.1 time: 0.048693 Sep 05 15:07:18.263558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1896/3655] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:07:18 2022] GET /compute/v2.1/servers/79f81a66-3708-4a39-976c-ad76174a0cfe => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 15:09:18.499385 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:09:18.499963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:09:18.512215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:18.512701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:18.513143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:18.513838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:18.514346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:18.514719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:18.520037 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 54430. Sep 05 15:09:18.540432 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:09:18.837300 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ac3c924a-939b-4aac-8840-a82143a7229a tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 204 len: 0 microversion: 2.20 time: 0.344826 Sep 05 15:09:18.837883 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1760/3656] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 5 15:09:18 2022] DELETE /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 15:09:18.845925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:09:18.846502 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 (ip 10.222.0.15) !!! Sep 05 15:09:18.847044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:09:18.847170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:09:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 (ip 10.222.0.15) !!! Sep 05 15:09:18.852874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:09:18.853495 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:09:18.864679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:18.873973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:18.873973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:18.873973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:18.873973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:18.874426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:18.874426 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 54436. Sep 05 15:09:19.118453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:19.127245 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:19.128679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:19.129827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-002387c3-62ed-40f8-9791-a1e286e46cd2 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1723 microversion: 2.20 time: 0.287689 Sep 05 15:09:19.130366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1897/3657] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:09:18 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1723 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:09:20.155824 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:09:20.161785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:09:20.163068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:20.163559 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:20.163996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:20.164696 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:20.165150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:20.165579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:20.427704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:20.436913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:20.439059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:20.440262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c0fb273-d98e-46fb-a81f-82fb53b389fe tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1723 microversion: 2.20 time: 0.288928 Sep 05 15:09:20.440880 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1761/3658] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:09:20 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1723 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:09:20.717146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-d8784c6f-cb8b-4fb2-8ddd-f17df05ffe93 req-bd99b7e4-6876-4e96-9f4c-229d9bb9c6c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f13ef78b-3501-4ec5-b8d3-ec4363e1a635", "name": "network-vif-deleted", "tag": "c375dec3-11a1-42b6-899d-e5fdf7a2dd13"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:09:20.727779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-d8784c6f-cb8b-4fb2-8ddd-f17df05ffe93 req-bd99b7e4-6876-4e96-9f4c-229d9bb9c6c7 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:20.728488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-d8784c6f-cb8b-4fb2-8ddd-f17df05ffe93 req-bd99b7e4-6876-4e96-9f4c-229d9bb9c6c7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:20.729821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-d8784c6f-cb8b-4fb2-8ddd-f17df05ffe93 req-bd99b7e4-6876-4e96-9f4c-229d9bb9c6c7 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:20.746328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-d8784c6f-cb8b-4fb2-8ddd-f17df05ffe93 req-bd99b7e4-6876-4e96-9f4c-229d9bb9c6c7 service nova] Creating event network-vif-deleted:c375dec3-11a1-42b6-899d-e5fdf7a2dd13 for instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 on hv-cinder-84290 Sep 05 15:09:20.754500 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-d8784c6f-cb8b-4fb2-8ddd-f17df05ffe93 req-bd99b7e4-6876-4e96-9f4c-229d9bb9c6c7 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100241 Sep 05 15:09:20.756044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1898/3659] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:09:21.465717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:09:21.466504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:09:21.473790 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:21.474275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:21.474709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:21.475498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:21.476180 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:21.476941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:21.509943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:21.510419 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:21.510879 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:21.511320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lazy-loading 'fault' on Instance uuid f13ef78b-3501-4ec5-b8d3-ec4363e1a635 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:09:21.554461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:21.562987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:21.564582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '91c691b6a7724d708bfc7424908516c8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '834730ab3cfd4d649fc270843d47b291', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:09:21.565956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3aaa1949-d63c-49fe-971e-ff15a14a9209 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 200 len: 1371 microversion: 2.20 time: 0.104218 Sep 05 15:09:21.566685 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1762/3660] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:09:21 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 1371 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 05 15:09:22.594163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:09:22.594895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:09:22.601063 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:22.601546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:22.601983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:22.602669 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:09:22.603150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:09:22.603579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:09:22.617191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] HTTP exception thrown: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Request method failure captured: Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 HTTP/1.1 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjxpzpwMCpWynQ6Zzh2snM7i91iUuxPmwJ6l97SKoPyr2fqdnkoGbip3271V04G-WxY00hgnXsFWHQGH6HK7z6SzFkdGMi74ICNbLBLo0GuUq_pjj_TMAEkD-N1zYKXbHnn0qIziX0u1PB07rTEPKOSEdKoGr4h-EOYJPWm2A18mKY Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:09:22.618910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_834730ab3cfd4d649fc270843d47b291"}]}] Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 91c691b6a7724d708bfc7424908516c8 Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:09:22.620884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': 'f13ef78b-3501-4ec5-b8d3-ec4363e1a635'} Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:09:22.622076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:09:22.624146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:09:22.625908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Returning 404 to user: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:09:22.625908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5f473c59-706a-4b6b-98bf-08bc19846344 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 404 len: 111 microversion: 2.20 time: 0.031644 Sep 05 15:09:22.625908 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1899/3661] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:09:22 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 15:09:22.629348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6e470b99-7419-48e2-92fe-68b52f056f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '.version_select at 0x7fb191537160>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:09:22.712465 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6e470b99-7419-48e2-92fe-68b52f056f76 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453927189" status: 204 len: 0 microversion: 2.20 time: 0.087117 Sep 05 15:09:22.713048 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1763/3662] 10.222.0.15 () {60 vars in 1262 bytes} [Mon Sep 5 15:09:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1453927189 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 05 15:13:02.686280 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:13:02.687072 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=8 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:02.687816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=12 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:02.688806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:13:02.689197 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:13:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e (ip 10.222.0.15) !!! Sep 05 15:13:02.692780 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:13:02.692950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:13:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e (ip 10.222.0.15) !!! Sep 05 15:13:02.694772 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:13:02.694926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:13:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e (ip 10.222.0.15) !!! Sep 05 15:13:02.700361 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:02.701046 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:02.725783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:02.726338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:02.728139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:02.728139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:02.728640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:02.729077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:02.756542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:13:03.070947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fa77f128-6b58-46ee-8d32-9058d802b738 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "DELETE /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 204 len: 0 microversion: 2.1 time: 0.386467 Sep 05 15:13:03.071546 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1900/3663] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:13:02 2022] DELETE /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 0 bytes in 388 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:13:03.077593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 15:13:03.078231 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:03.079211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:03.080502 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:13:03.080634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e (ip 10.222.0.15) !!! Sep 05 15:13:03.082440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:13:03.082587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e (ip 10.222.0.15) !!! Sep 05 15:13:03.086217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:13:03.086710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:13:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e (ip 10.222.0.15) !!! Sep 05 15:13:03.105354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:03.105965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:03.118977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:03.119535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:03.128918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:03.128918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:03.128918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:03.128918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:03.261255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:03.268646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-49d95c0a-4aa8-4bc1-8c68-05de5936a3e8 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1507 microversion: 2.1 time: 0.193088 Sep 05 15:13:03.269211 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1764/3664] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:03 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1507 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:04.292590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:04.293284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:04.301559 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:04.302037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:04.302486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:04.303181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:04.303630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:04.304049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:04.309877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 54608. Sep 05 15:13:04.434474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:04.442562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-423e0d6d-4147-4077-8a8a-58f0794fc8de tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1507 microversion: 2.1 time: 0.154096 Sep 05 15:13:04.447610 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1901/3665] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:04 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1507 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:05.466698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:05.468608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:05.479571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:05.481131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:05.481844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:05.483070 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:05.483592 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:05.484091 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:05.490312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 54628. Sep 05 15:13:05.782453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:05.797864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5a35ac1f-deae-4eef-bdbe-294d8e51a367 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1507 microversion: 2.1 time: 0.336795 Sep 05 15:13:05.800337 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1765/3666] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:05 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1507 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:06.082346 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-f9685b13-0613-4965-b303-4be9d05adf31 req-843e1f3f-cab5-4aa5-94d4-dd61afe47264 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3060a33f-220b-4ef5-a330-ffca8c4c871e", "name": "network-vif-deleted", "tag": "69006b7a-d9b5-4c63-991e-0ee9da068a63"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:06.095247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f9685b13-0613-4965-b303-4be9d05adf31 req-843e1f3f-cab5-4aa5-94d4-dd61afe47264 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:06.096196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f9685b13-0613-4965-b303-4be9d05adf31 req-843e1f3f-cab5-4aa5-94d4-dd61afe47264 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:06.098285 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f9685b13-0613-4965-b303-4be9d05adf31 req-843e1f3f-cab5-4aa5-94d4-dd61afe47264 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:06.111102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-f9685b13-0613-4965-b303-4be9d05adf31 req-843e1f3f-cab5-4aa5-94d4-dd61afe47264 service nova] Creating event network-vif-deleted:69006b7a-d9b5-4c63-991e-0ee9da068a63 for instance 3060a33f-220b-4ef5-a330-ffca8c4c871e on hv-cinder-84290 Sep 05 15:13:06.117088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-f9685b13-0613-4965-b303-4be9d05adf31 req-843e1f3f-cab5-4aa5-94d4-dd61afe47264 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038032 Sep 05 15:13:06.118320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1902/3667] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:06.303543 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-726e7a2d-284c-4121-904d-5427bc6b1bc3 req-e5f1b9d4-0def-438c-b230-1c647d01640d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a50e765d-9688-493d-ac8c-fd4bf3bb5580", "name": "network-vif-deleted", "tag": "9de7df6c-259e-4f36-ab19-ce48818db64b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:06.331060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-726e7a2d-284c-4121-904d-5427bc6b1bc3 req-e5f1b9d4-0def-438c-b230-1c647d01640d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:06.331834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-726e7a2d-284c-4121-904d-5427bc6b1bc3 req-e5f1b9d4-0def-438c-b230-1c647d01640d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:06.332480 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-726e7a2d-284c-4121-904d-5427bc6b1bc3 req-e5f1b9d4-0def-438c-b230-1c647d01640d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:06.352960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-726e7a2d-284c-4121-904d-5427bc6b1bc3 req-e5f1b9d4-0def-438c-b230-1c647d01640d service nova] Creating event network-vif-deleted:9de7df6c-259e-4f36-ab19-ce48818db64b for instance a50e765d-9688-493d-ac8c-fd4bf3bb5580 on hv-cinder-84290 Sep 05 15:13:06.361491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-726e7a2d-284c-4121-904d-5427bc6b1bc3 req-e5f1b9d4-0def-438c-b230-1c647d01640d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.188279 Sep 05 15:13:06.362821 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1766/3668] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:06.823062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:06.826886 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:06.829930 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:06.830414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:06.830869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:06.831573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:06.832008 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:06.832552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:06.891950 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:06.892441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:06.892879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:06.893334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'fault' on Instance uuid 3060a33f-220b-4ef5-a330-ffca8c4c871e {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:13:06.989906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:07.007952 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-69895f88-8de1-4eb5-9745-957d8c989650 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 200 len: 1311 microversion: 2.1 time: 0.189511 Sep 05 15:13:07.023231 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1903/3669] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:06 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 1311 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:08.032581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:08.034400 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 3060a33f-220b-4ef5-a330-ffca8c4c871e] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:08.042942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.043597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.044100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.044943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.045395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.045815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.060925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] HTTP exception thrown: Instance 3060a33f-220b-4ef5-a330-ffca8c4c871e could not be found. Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Request method failure captured: Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e HTTP/1.1 Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjvME7A0Oa-XHElvBJnAvhVALXYUKaCZry8Wznb1X8cZXgDmXzbJDt9GmasZp9dLO_bm1vCuWtDApCkJtVFPWhKFkqyEVbSIm1wLc1Mtto0I-3DysC1-aaIbYKyu1Ki3RBx4vPz8Qoy023vk1pa6_17adNlOqGIo-hAh9LW1U_N3do Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:13:08.062558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2af009055e3b4bdda73a770242253b0d"}]}] Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 9136f02e6c664f27b3f4fd35475f0eea Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 3060a33f-220b-4ef5-a330-ffca8c4c871e could not be found. Sep 05 15:13:08.064326 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '3060a33f-220b-4ef5-a330-ffca8c4c871e'} Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3060a33f-220b-4ef5-a330-ffca8c4c871e could not be found. Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:13:08.074819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3060a33f-220b-4ef5-a330-ffca8c4c871e could not be found. Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3060a33f-220b-4ef5-a330-ffca8c4c871e could not be found. Sep 05 15:13:08.076401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:13:08.078044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Returning 404 to user: Instance 3060a33f-220b-4ef5-a330-ffca8c4c871e could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:13:08.078044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-75796059-c0dd-4f63-ae11-e215a54051df tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e" status: 404 len: 111 microversion: 2.1 time: 0.036591 Sep 05 15:13:08.078044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1767/3670] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:08 2022] GET /compute/v2.1/servers/3060a33f-220b-4ef5-a330-ffca8c4c871e => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:13:08.078317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:08.078317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:08.085078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.085830 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.086646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.087470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.088813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.089860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.122273 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:13:08.360827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e8617bc5-5839-441a-8147-3173e036c131 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "DELETE /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 204 len: 0 microversion: 2.1 time: 0.291706 Sep 05 15:13:08.361592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1904/3671] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:13:08 2022] DELETE /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:13:08.369681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:08.370636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:08.377810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.378578 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.379244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.380746 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.381201 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.381626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.383244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-546475e8-53ed-451b-beb1-67109edcc4f6 req-6faa8f29-3198-4739-8a89-adf371880cda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04bf5a93-4e3a-4291-afcd-c0213a44d540", "name": "network-vif-deleted", "tag": "f9048ed4-216e-453c-8839-d8d95b554ffe"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:08.392794 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-546475e8-53ed-451b-beb1-67109edcc4f6 req-6faa8f29-3198-4739-8a89-adf371880cda service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:08.399454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-546475e8-53ed-451b-beb1-67109edcc4f6 req-6faa8f29-3198-4739-8a89-adf371880cda service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:08.399454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-546475e8-53ed-451b-beb1-67109edcc4f6 req-6faa8f29-3198-4739-8a89-adf371880cda service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:08.406554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-546475e8-53ed-451b-beb1-67109edcc4f6 req-6faa8f29-3198-4739-8a89-adf371880cda service nova] Creating event network-vif-deleted:f9048ed4-216e-453c-8839-d8d95b554ffe for instance 04bf5a93-4e3a-4291-afcd-c0213a44d540 on hv-cinder-84290 Sep 05 15:13:08.412474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-546475e8-53ed-451b-beb1-67109edcc4f6 req-6faa8f29-3198-4739-8a89-adf371880cda service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034358 Sep 05 15:13:08.413783 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1905/3672] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:08.749232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:08.757917 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e31e9360-1fbe-4300-ac8d-902368d50959 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.392153 Sep 05 15:13:08.758587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1768/3673] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:08 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:09.782362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:09.783047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:09.790049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:09.790538 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:09.791012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:09.791709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:09.792159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:09.792792 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:09.932269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:09.940100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d952d38-3e64-41f9-bfa3-54226a91d13c tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1521 microversion: 2.1 time: 0.163072 Sep 05 15:13:09.940672 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1906/3674] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:09 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:10.429876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-feb497e8-4b74-40cf-a528-3a1ca458feac req-3a9117d3-cdad-49b5-bdfc-c0556191cfe6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "90621a62-caad-4a01-97cf-67f270d9de0b", "name": "network-vif-deleted", "tag": "a0de9f2d-b0aa-4759-9953-d5d2bf8eb09c"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:10.439566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-feb497e8-4b74-40cf-a528-3a1ca458feac req-3a9117d3-cdad-49b5-bdfc-c0556191cfe6 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:10.440034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-feb497e8-4b74-40cf-a528-3a1ca458feac req-3a9117d3-cdad-49b5-bdfc-c0556191cfe6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:10.440456 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-feb497e8-4b74-40cf-a528-3a1ca458feac req-3a9117d3-cdad-49b5-bdfc-c0556191cfe6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:10.450978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-feb497e8-4b74-40cf-a528-3a1ca458feac req-3a9117d3-cdad-49b5-bdfc-c0556191cfe6 service nova] Creating event network-vif-deleted:a0de9f2d-b0aa-4759-9953-d5d2bf8eb09c for instance 90621a62-caad-4a01-97cf-67f270d9de0b on hv-cinder-84290 Sep 05 15:13:10.457207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-feb497e8-4b74-40cf-a528-3a1ca458feac req-3a9117d3-cdad-49b5-bdfc-c0556191cfe6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030030 Sep 05 15:13:10.457207 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1769/3675] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:10.963027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:10.963639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:10.970089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:10.970573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:10.971043 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:10.971735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:10.972190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:10.972615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:11.003619 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:11.004094 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:11.004528 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:11.004971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'fault' on Instance uuid 90621a62-caad-4a01-97cf-67f270d9de0b {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:13:11.048548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:11.056105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ade2d42-3c40-4927-afa1-334d8d97b436 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1311 microversion: 2.1 time: 0.096966 Sep 05 15:13:11.056667 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1907/3676] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:10 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1311 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:12.079378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:12.080075 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:12.086823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:12.088586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:12.088586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:12.088586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:12.088943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:12.089305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:12.119409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:12.119886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:12.120321 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:12.120766 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'fault' on Instance uuid 90621a62-caad-4a01-97cf-67f270d9de0b {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:13:12.161994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:12.169469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8a3d4b12-4480-4d0f-824d-8a9cbade4471 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1311 microversion: 2.1 time: 0.094837 Sep 05 15:13:12.170023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1770/3677] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:12 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:13.193670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:13.194535 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:13.201010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:13.201486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:13.201915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:13.202585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:13.203059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:13.203475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:13.234398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:13.234894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:13.235324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:13.235758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'fault' on Instance uuid 90621a62-caad-4a01-97cf-67f270d9de0b {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:13:13.276441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:13.283947 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c1187b19-4378-40a2-a118-3f733d9fb5bc tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1311 microversion: 2.1 time: 0.094822 Sep 05 15:13:13.284505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1908/3678] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:13 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:14.305990 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:14.306586 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:14.313271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:14.313756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:14.314193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:14.314941 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:14.315423 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:14.315874 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:14.346076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:14.346498 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:14.347055 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:14.347416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lazy-loading 'fault' on Instance uuid 90621a62-caad-4a01-97cf-67f270d9de0b {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:13:14.392182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9136f02e6c664f27b3f4fd35475f0eea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2af009055e3b4bdda73a770242253b0d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:14.399862 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d87e9027-583b-4b2e-bf76-04a67a588013 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 200 len: 1311 microversion: 2.1 time: 0.098459 Sep 05 15:13:14.406080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1771/3679] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:14 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:15.422715 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:15.423425 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] [instance: 90621a62-caad-4a01-97cf-67f270d9de0b] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:15.429692 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:15.430171 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:15.430624 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:15.431314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:15.431767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:15.432189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:15.445955 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] HTTP exception thrown: Instance 90621a62-caad-4a01-97cf-67f270d9de0b could not be found. Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Request method failure captured: Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b HTTP/1.1 Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjvME7A0Oa-XHElvBJnAvhVALXYUKaCZry8Wznb1X8cZXgDmXzbJDt9GmasZp9dLO_bm1vCuWtDApCkJtVFPWhKFkqyEVbSIm1wLc1Mtto0I-3DysC1-aaIbYKyu1Ki3RBx4vPz8Qoy023vk1pa6_17adNlOqGIo-hAh9LW1U_N3do Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:13:15.447249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/2af009055e3b4bdda73a770242253b0d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_2af009055e3b4bdda73a770242253b0d"}]}] Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 2af009055e3b4bdda73a770242253b0d Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-252012321 Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 9136f02e6c664f27b3f4fd35475f0eea Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-ServerRescueNegativeTestJSON-252012321-project Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 90621a62-caad-4a01-97cf-67f270d9de0b could not be found. Sep 05 15:13:15.448826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '90621a62-caad-4a01-97cf-67f270d9de0b'} Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 90621a62-caad-4a01-97cf-67f270d9de0b could not be found. Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:13:15.449863 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 90621a62-caad-4a01-97cf-67f270d9de0b could not be found. Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 90621a62-caad-4a01-97cf-67f270d9de0b could not be found. Sep 05 15:13:15.451406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:13:15.452833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] Returning 404 to user: Instance 90621a62-caad-4a01-97cf-67f270d9de0b could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:13:15.452833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5b86bb4f-f934-4a9a-aa5d-2b4a972b43c5 tempest-ServerRescueNegativeTestJSON-252012321 tempest-ServerRescueNegativeTestJSON-252012321-project] 10.222.0.15 "GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b" status: 404 len: 111 microversion: 2.1 time: 0.030004 Sep 05 15:13:15.452833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1909/3680] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:15 2022] GET /compute/v2.1/servers/90621a62-caad-4a01-97cf-67f270d9de0b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:13:26.332527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=20 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:26.333277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=40 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:26.449972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-857a9745-dc4a-4c26-9d05-6895f1b7037a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: .version_select at 0x7fb194d3d0d0>, body: {"keypair": {"name": "tempest-keypair-42259484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOuDb902GwT5rgDFFF1gdRncYXaQD23zZCTzxr1QwVzGHIBASUiFtx0gIq1cUu/ysmJFYBOh8XbQatYxeF61rpBqKP4lUOSJmUajG0HSIiei6UI0q/S++JIKe3pPqi4ZZw=="}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:26.464909 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-857a9745-dc4a-4c26-9d05-6895f1b7037a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for project 7c858eb651e44140960444974d8bc4c4. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:13:26.468650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-857a9745-dc4a-4c26-9d05-6895f1b7037a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for user 3ad73a36c45a4763b00027457fb4117f and project 7c858eb651e44140960444974d8bc4c4. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:13:26.577975 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-857a9745-dc4a-4c26-9d05-6895f1b7037a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.250718 Sep 05 15:13:26.578631 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1772/3681] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 15:13:26 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:28.823524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-788761741", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "443ae9fa-3bc9-4152-85eb-d266473db248"}], "security_groups": [{"name": "tempest-securitygroup--825874389"}], "key_name": "tempest-keypair-42259484", "user_data": "}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:28.832659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:28.833311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:28.936322 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] validate_networks() for [('443ae9fa-3bc9-4152-85eb-d266473db248', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 15:13:29.386341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 15:13:29.386761 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 15:13:29.387328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 15:13:29.387745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 15:13:29.388153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 15:13:29.397939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:29.399175 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:29.400012 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:29.401980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:29.402774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:29.403409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:29.423743 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for project 7c858eb651e44140960444974d8bc4c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:13:29.427845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for user 3ad73a36c45a4763b00027457fb4117f and project 7c858eb651e44140960444974d8bc4c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:13:29.440158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 15:13:29.442776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 15:13:29.532868 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-618fdd6e-66ac-4cbf-8a24-313d692d1e5e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.713034 Sep 05 15:13:29.533998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1910/3682] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 15:13:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 715 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 15:13:29.546655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3567a683-3254-4179-9c62-6adb0038832c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:29.548092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3567a683-3254-4179-9c62-6adb0038832c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:29.641770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3567a683-3254-4179-9c62-6adb0038832c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:29.649607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3567a683-3254-4179-9c62-6adb0038832c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1235 microversion: 2.1 time: 0.107460 Sep 05 15:13:29.653607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1773/3683] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:29 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1235 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:30.677963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d364f5a9-52df-4b88-8e91-36aa74acbc84 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:30.678568 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d364f5a9-52df-4b88-8e91-36aa74acbc84 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:30.731657 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d364f5a9-52df-4b88-8e91-36aa74acbc84 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:30.739260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d364f5a9-52df-4b88-8e91-36aa74acbc84 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1235 microversion: 2.1 time: 0.065699 Sep 05 15:13:30.739737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1911/3684] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:30 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:31.762765 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:31.763402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:31.769882 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:31.770366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:31.770823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:31.771528 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:31.771981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:31.772401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:31.835204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:31.842804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-752c3080-3fc3-4f09-95b2-9632b3044416 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1287 microversion: 2.1 time: 0.084530 Sep 05 15:13:31.843364 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1774/3685] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:31 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1287 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:32.865579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:32.866299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:32.873396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:32.873883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:32.874317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:32.875048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:32.875487 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:32.875912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:33.010676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:33.018666 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8acd26f0-8025-4f93-8c3f-e278433b7a4b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.157041 Sep 05 15:13:33.019289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1912/3686] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:32 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:33.669382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-240abbde-c0b6-4ffe-8cc4-396392982f6f req-3ba5c3e4-7594-4d87-966c-76cbcf7c5855 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32dac823-da0b-4b04-9a66-2ac2dc469b90", "tag": "4ecd287f-a5a1-4f21-82cd-e5d3a622004b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:33.682330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-240abbde-c0b6-4ffe-8cc4-396392982f6f req-3ba5c3e4-7594-4d87-966c-76cbcf7c5855 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:33.683422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-240abbde-c0b6-4ffe-8cc4-396392982f6f req-3ba5c3e4-7594-4d87-966c-76cbcf7c5855 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:33.684246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-240abbde-c0b6-4ffe-8cc4-396392982f6f req-3ba5c3e4-7594-4d87-966c-76cbcf7c5855 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:33.697708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-240abbde-c0b6-4ffe-8cc4-396392982f6f req-3ba5c3e4-7594-4d87-966c-76cbcf7c5855 service nova] Creating event network-changed:4ecd287f-a5a1-4f21-82cd-e5d3a622004b for instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 on hv-cinder-84290 Sep 05 15:13:33.702575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-240abbde-c0b6-4ffe-8cc4-396392982f6f req-3ba5c3e4-7594-4d87-966c-76cbcf7c5855 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037087 Sep 05 15:13:33.703204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1775/3687] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:34.042162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:34.042778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:34.049209 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:34.049699 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:34.050144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:34.050859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:34.051320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:34.051747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:34.183122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:34.190874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-78b4ce6b-cdd3-4375-b94a-1a470da20ffa tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.152604 Sep 05 15:13:34.191693 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1913/3688] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:34 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:35.215421 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:35.216939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:35.222263 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:35.222742 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:35.223208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:35.223888 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:35.224340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:35.224763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:35.352482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:35.360043 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-75b6008f-beb8-4aea-8296-3a8ece3dc894 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.149316 Sep 05 15:13:35.360595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1776/3689] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:35 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:36.384456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:36.385105 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:36.391204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:36.391681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:36.392490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:36.392779 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:36.393801 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:36.394407 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:36.524379 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:36.532035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c038122c-791f-4db3-88cb-ca3f11f7e9d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.152648 Sep 05 15:13:36.532623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1914/3690] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:36 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:37.556018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:37.556630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:37.562678 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:37.563193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:37.563624 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:37.564324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:37.564740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:37.565233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:37.692590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:37.700245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a7f4a6b2-1b25-4e1c-851e-5a42630530f6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.148812 Sep 05 15:13:37.700804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1777/3691] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:37 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:38.723870 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:38.724632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:38.731353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:38.731914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:38.732424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:38.733110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:38.733562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:38.733980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:38.872464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:38.880190 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-96f3330c-6f85-490a-ba32-ab1c7552d4d9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.160420 Sep 05 15:13:38.881040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1915/3692] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:38 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:39.461918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-4d38702f-d78a-4617-bd08-5395fb901dc8 req-85848926-7ae2-4529-bb1e-deead748ad85 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dac823-da0b-4b04-9a66-2ac2dc469b90", "name": "network-vif-plugged", "status": "completed", "tag": "4ecd287f-a5a1-4f21-82cd-e5d3a622004b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:39.471252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4d38702f-d78a-4617-bd08-5395fb901dc8 req-85848926-7ae2-4529-bb1e-deead748ad85 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:39.471726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4d38702f-d78a-4617-bd08-5395fb901dc8 req-85848926-7ae2-4529-bb1e-deead748ad85 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:39.472170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-4d38702f-d78a-4617-bd08-5395fb901dc8 req-85848926-7ae2-4529-bb1e-deead748ad85 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:39.483655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-4d38702f-d78a-4617-bd08-5395fb901dc8 req-85848926-7ae2-4529-bb1e-deead748ad85 service nova] Creating event network-vif-plugged:4ecd287f-a5a1-4f21-82cd-e5d3a622004b for instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 on hv-cinder-84290 Sep 05 15:13:39.488573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-4d38702f-d78a-4617-bd08-5395fb901dc8 req-85848926-7ae2-4529-bb1e-deead748ad85 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084194 Sep 05 15:13:39.489184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1778/3693] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:39.903750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:39.904362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:39.906195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:39.911406 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:39.917195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:39.917195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:39.917195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:39.917195 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:39.917625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:40.045140 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:40.053184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-16f85637-68d4-4b00-8934-666c85a25154 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.153352 Sep 05 15:13:40.053752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1916/3694] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:39 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:41.073715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:41.078318 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:41.087030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:41.087030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:41.087030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:41.087030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:41.087494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:41.087715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:41.088131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:41.218433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:41.224980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9bf6105e-cacf-4411-a2ce-a43259b6f9cd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1360 microversion: 2.1 time: 0.152143 Sep 05 15:13:41.225475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1779/3695] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:41 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1360 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:42.247073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:42.247685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:42.249476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=8 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:13:42.254632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:42.255172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:42.255861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:42.256548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:42.257004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:42.257428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:42.388966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:13:42.396514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f192eda2-23aa-425a-8504-f8bdee7b546b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1545 microversion: 2.1 time: 0.153585 Sep 05 15:13:42.397091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1917/3696] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:13:42 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1545 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:13:42.420160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:13:42.420655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:13:42.427103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:42.427588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:42.428025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:42.428714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:42.429168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:42.429597 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:42.506593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4230297f-a7c9-4005-8889-b19cd2c1f86b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090924 Sep 05 15:13:42.507209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1780/3697] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 15:13:42 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:13:43.733510 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-35b06b97-9e40-4851-b6e0-0c4ef58aa985 req-59018f37-b951-4ce2-914a-4e699e99eb0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "32dac823-da0b-4b04-9a66-2ac2dc469b90", "tag": "4ecd287f-a5a1-4f21-82cd-e5d3a622004b"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:13:43.743561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-35b06b97-9e40-4851-b6e0-0c4ef58aa985 req-59018f37-b951-4ce2-914a-4e699e99eb0a service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:13:43.744039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-35b06b97-9e40-4851-b6e0-0c4ef58aa985 req-59018f37-b951-4ce2-914a-4e699e99eb0a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:13:43.744479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-35b06b97-9e40-4851-b6e0-0c4ef58aa985 req-59018f37-b951-4ce2-914a-4e699e99eb0a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:13:43.908003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-35b06b97-9e40-4851-b6e0-0c4ef58aa985 req-59018f37-b951-4ce2-914a-4e699e99eb0a service nova] Creating event network-changed:4ecd287f-a5a1-4f21-82cd-e5d3a622004b for instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 on hv-cinder-84290 Sep 05 15:13:43.913580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-35b06b97-9e40-4851-b6e0-0c4ef58aa985 req-59018f37-b951-4ce2-914a-4e699e99eb0a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.183806 Sep 05 15:13:43.914196 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1918/3698] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:14:59.003481 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:14:59.004230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=32 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:14:59.009338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:14:59.013844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:14:59.016352 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:14:59.016828 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:14:59.017255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:14:59.017928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:14:59.018377 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:14:59.018820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:14:59.042834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-45503a07-f288-4a7e-8a6f-bf0a5d69abb8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/ips" status: 200 len: 144 microversion: 2.1 time: 0.041427 Sep 05 15:14:59.043438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1781/3699] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 15:14:59 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:15:01.125595 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:15:01.126336 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=40 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:15:01.131291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:01.132120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:01.138170 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.138644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.144753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.144753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.144753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.144753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.153822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a HTTP/1.1 Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:15:01.155512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.156652 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': 'dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a'} Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:15:01.157333 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.158475 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.159753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:15:01.159753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9d0ddcaa-0aa8-4d14-8871-aa1f834e8038 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 404 len: 111 microversion: 2.1 time: 0.033327 Sep 05 15:15:01.159753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1919/3700] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:15:01 2022] DELETE /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:15:01.165285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:01.165927 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:01.173755 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.174232 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.174669 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.175378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.175834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.176256 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.189492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a HTTP/1.1 Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:15:01.191149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.192363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': 'dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a'} Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:15:01.193053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. Sep 05 15:15:01.194217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.195280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:15:01.195280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-6943e5eb-7226-4b55-b4e4-b835fae24ef2 tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a" status: 404 len: 111 microversion: 2.1 time: 0.031125 Sep 05 15:15:01.195280 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1782/3701] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:01 2022] GET /compute/v2.1/servers/dc8b2e66-3f4c-459d-aa4a-aba1ac325d7a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:15:01.202026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:01.202516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:01.209184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.209658 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.210089 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.210756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.211284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.211703 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.224990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf HTTP/1.1 Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:15:01.226496 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.227845 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '8135d8b8-fc8e-404c-a3d2-90595028a8bf'} Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:15:01.231093 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.232181 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.233117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:15:01.233117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3c5bb8c7-ebc2-4da6-8055-189c05092d5e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 404 len: 111 microversion: 2.1 time: 0.030702 Sep 05 15:15:01.233117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1920/3702] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:15:01 2022] DELETE /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:15:01.236341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:01.237513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 8135d8b8-fc8e-404c-a3d2-90595028a8bf] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:01.243120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.243595 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.244025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.244697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.245170 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.245584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.259420 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf HTTP/1.1 Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:15:01.261521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.263018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '8135d8b8-fc8e-404c-a3d2-90595028a8bf'} Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:15:01.263859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. Sep 05 15:15:01.265224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:01.266413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 8135d8b8-fc8e-404c-a3d2-90595028a8bf could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:15:01.266413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f98737fa-1198-471c-ac1b-fdbe22c4697d tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf" status: 404 len: 111 microversion: 2.1 time: 0.030526 Sep 05 15:15:01.266413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1783/3703] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:01 2022] GET /compute/v2.1/servers/8135d8b8-fc8e-404c-a3d2-90595028a8bf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:15:01.415461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4224391a-76ad-45d2-b53e-35e6b2cbab2e"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:15:01.417923 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:01.423834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.424314 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.424748 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:01.425434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:01.425895 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:01.426321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:02.357782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f0a16151-367f-4184-996a-3d11f5ed3f36 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.946594 Sep 05 15:15:02.358450 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1921/3704] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 15:15:01 2022] POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-volume_attachments => generated 194 bytes in 948 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:15:02.518622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:02.519141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:02.525676 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:02.526636 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:02.527120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:02.527817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:02.528274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:02.528704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:02.543067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab HTTP/1.1 Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:15:02.544605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.545819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '57a94776-abef-42ea-a633-c70dedfdacab'} Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:15:02.546716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.547908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.549095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:15:02.549095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d9b81da7-cfb8-4383-8206-c7cd698b3dcb tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 404 len: 111 microversion: 2.1 time: 0.031313 Sep 05 15:15:02.549095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1784/3705] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:15:02 2022] DELETE /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:15:02.555121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:02.555813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] [instance: 57a94776-abef-42ea-a633-c70dedfdacab] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:02.561822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:02.562306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:02.562744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:02.563474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:02.563927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:02.564350 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:02.577122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] HTTP exception thrown: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Request method failure captured: Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab HTTP/1.1 Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjrzjefdDFCVo6yrIaJco9oEBVrdaZ1S4iIWCUF_KfDDSodPN-zvYzOhwLZN8SjggOzp88LasNmwlK0N-dl9Cr_BddJGQQl2tl_UUDWk2YQ95oSIVFUqWJVma_l1pHpN51JKtS_pb9Ffi8Q-pHiB3COCLOYoQNmg_lT-HlXYnHxHpI Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:15:02.578706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/0f14cb621ef04aa3a17159e418d6c7aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_0f14cb621ef04aa3a17159e418d6c7aa"}]}] Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 0f14cb621ef04aa3a17159e418d6c7aa Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1665177466 Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c078e655c9454316aa7afe13a6b565e7 Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeNegativeTest-1665177466-project Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.580010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '57a94776-abef-42ea-a633-c70dedfdacab'} Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:15:02.580769 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. Sep 05 15:15:02.581978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:15:02.583077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] Returning 404 to user: Instance 57a94776-abef-42ea-a633-c70dedfdacab could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:15:02.583077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3b5d0d1d-04f5-4181-964a-d7679dfaaa3e tempest-AttachVolumeNegativeTest-1665177466 tempest-AttachVolumeNegativeTest-1665177466-project] 10.222.0.15 "GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab" status: 404 len: 111 microversion: 2.1 time: 0.029282 Sep 05 15:15:02.583077 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1922/3706] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:02 2022] GET /compute/v2.1/servers/57a94776-abef-42ea-a633-c70dedfdacab => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:15:10.966587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-98f50e90-5a3e-40dc-b472-fb02af46bb85 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:15:10.972852 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98f50e90-5a3e-40dc-b472-fb02af46bb85 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:10.973346 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98f50e90-5a3e-40dc-b472-fb02af46bb85 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:10.973844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-98f50e90-5a3e-40dc-b472-fb02af46bb85 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:11.036379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-98f50e90-5a3e-40dc-b472-fb02af46bb85 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Going to try to stop instance {{(pid=127609) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 05 15:15:11.265845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-98f50e90-5a3e-40dc-b472-fb02af46bb85 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action" status: 202 len: 0 microversion: 2.1 time: 0.303307 Sep 05 15:15:11.266523 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1785/3707] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 15:15:10 2022] POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action => generated 0 bytes in 305 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:15:11.274644 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:11.275294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:11.282230 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:11.283017 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:11.283469 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:11.284162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:11.284621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:11.285053 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:11.417867 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:11.426636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1d43297-264e-48b2-8f93-4fcdfb7b46de tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.155929 Sep 05 15:15:11.427228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1923/3708] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:11 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:12.449811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:12.450503 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:12.457117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:12.457591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:12.458020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:12.458698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:12.459173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:12.459665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:12.742351 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:12.751227 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0a10ba3a-8b94-4a3a-a15e-db1be7a1c576 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.305523 Sep 05 15:15:12.751791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1786/3709] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:12 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:13.775002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:13.775614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:13.782516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:13.783009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:13.783477 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:13.784158 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:13.784620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:13.785038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:13.913421 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:13.921455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-89ee5628-9774-47a1-a856-8562823c90a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.150336 Sep 05 15:15:13.922009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1924/3710] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:13 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:14.944116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:14.944721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:14.951517 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:14.952492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:14.952946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:14.953655 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:14.954098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:14.954511 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:15.082310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:15.090557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-19eefae2-c403-4dac-b505-e775f0c192e6 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.150337 Sep 05 15:15:15.091155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1787/3711] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:14 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:16.113416 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:16.114019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:16.120331 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:16.120807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:16.121250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:16.121905 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:16.122358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:16.122778 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:16.252334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:16.261187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0dd6f79b-6f84-4a02-8eda-b45af99f7285 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.151608 Sep 05 15:15:16.261738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1925/3712] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:16 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:17.285290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:17.285911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:17.292233 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:17.292716 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:17.293158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:17.293847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:17.294306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:17.294731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:17.423369 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:17.431452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1497c320-21ab-4eeb-80ad-7851a32e7a8c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.150564 Sep 05 15:15:17.432017 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1788/3713] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:17 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:18.453525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:18.454267 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:18.460625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:18.461102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:18.461910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:18.462436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:18.462931 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:18.463353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:18.593767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:18.601976 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5a698017-b363-4fb1-a385-1a6578bf3ca0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.152169 Sep 05 15:15:18.602542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1926/3714] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:18 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:19.625463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:19.626100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:19.632789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:19.633274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:19.633709 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:19.634396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:19.634891 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:19.635315 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:19.766916 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:19.775035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9d5f70e8-b689-4982-ac4f-3ec5e8ecf358 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.153469 Sep 05 15:15:19.775601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1789/3715] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:19 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:20.799095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:20.799698 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:20.806289 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:20.806765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:20.807223 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:20.807898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:20.808376 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:20.808799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:20.937798 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:20.946544 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-148bb05f-9376-4d75-b8a7-1f63b44843c8 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.151357 Sep 05 15:15:20.947506 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1927/3716] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:20 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:21.970402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:21.971539 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:21.978165 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:21.978582 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:21.979060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:21.979794 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:21.980250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:21.980670 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:22.113783 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:22.121933 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1af7686d-f34f-4b93-bb4a-e81d3cef3825 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.155482 Sep 05 15:15:22.122527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1790/3717] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:21 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:23.145625 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:23.146161 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:23.152623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:23.153098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:23.153531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:23.154211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:23.154689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:23.155133 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:23.342235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:23.350971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e39bb712-635c-4682-9105-fb26b6a3b081 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.209374 Sep 05 15:15:23.351533 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1928/3718] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:23 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:24.373281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:24.373884 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:24.380715 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:24.385359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:24.385359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:24.385359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:24.385359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:24.385667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:24.516100 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:24.524953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8013cb7f-da0a-4d6d-bf46-70bec0b928f7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.155474 Sep 05 15:15:24.525844 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1791/3719] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:24 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:25.547188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:25.547881 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:25.554587 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:25.559821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:25.559821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:25.559821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:25.559821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:25.560121 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:25.684649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:25.692835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-f2836f62-f005-4d94-a2c8-7678b34be0a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.149430 Sep 05 15:15:25.693766 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1929/3720] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:25 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:26.716241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:26.716875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:26.723797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:26.724273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:26.724704 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:26.725383 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:26.725829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:26.726244 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:26.857829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:26.866634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-10c0d3b9-14e3-433b-98a1-b742923e8de4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1719 microversion: 2.1 time: 0.154269 Sep 05 15:15:26.871137 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1792/3721] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:26 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1719 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:27.888876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:27.889503 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:27.895944 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:27.896430 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:27.896869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:27.897617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:27.898079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:27.898505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:28.024739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:28.033365 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b1904f52-f4f5-4867-bcf2-4c46a72c22f2 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1696 microversion: 2.1 time: 0.148031 Sep 05 15:15:28.034004 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1930/3722] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:27 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1696 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:28.056071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4764eca5-274f-40b7-b887-b1d417dee0e1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:15:28.062451 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4764eca5-274f-40b7-b887-b1d417dee0e1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:28.062972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4764eca5-274f-40b7-b887-b1d417dee0e1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:28.063409 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4764eca5-274f-40b7-b887-b1d417dee0e1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:28.084899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4764eca5-274f-40b7-b887-b1d417dee0e1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Going to try to start instance {{(pid=127609) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 05 15:15:28.300229 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4764eca5-274f-40b7-b887-b1d417dee0e1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action" status: 202 len: 0 microversion: 2.1 time: 0.247651 Sep 05 15:15:28.300857 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1793/3723] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 15:15:28 2022] POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:15:28.308943 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:28.309632 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:28.315705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:28.316199 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:28.316639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:28.317507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:28.317962 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:28.318385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:28.451241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:28.459939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-58f982c8-a98a-40f7-b167-3cfc6c6ad0ca tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1705 microversion: 2.1 time: 0.154833 Sep 05 15:15:28.460507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1931/3724] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:28 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1705 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:29.484217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:29.484918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:29.491813 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:29.492313 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:29.492750 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:29.493442 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:29.493897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:29.494395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:29.633703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:29.641887 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1517f85f-a800-413d-9cfd-acaf8b557821 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1705 microversion: 2.1 time: 0.162514 Sep 05 15:15:29.642447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1794/3725] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:29 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1705 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:15:30.664714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:15:30.665327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:15:30.672086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:30.672597 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:30.673029 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:30.674372 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:15:30.675812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:15:30.675812 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:15:30.807747 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:15:30.816660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6b086857-1139-4a7b-8a43-34043725bde0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1709 microversion: 2.1 time: 0.155939 Sep 05 15:15:30.817227 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1932/3726] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:15:30 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1709 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:35.213721 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=28 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:16:35.214428 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=78,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:16:35.218998 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:35.219488 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:35.225132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:35.225606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:35.226030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:35.236182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:35.236182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:35.236182 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:35.307822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lazy-loading 'services' on Instance uuid 32dac823-da0b-4b04-9a66-2ac2dc469b90 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:16:35.492020 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-61aa3c62-8807-4d71-ad69-2b71fb13375f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-volume_attachments/4224391a-76ad-45d2-b53e-35e6b2cbab2e" status: 202 len: 0 microversion: 2.1 time: 0.279888 Sep 05 15:16:35.492951 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1795/3727] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 15:16:35 2022] DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-volume_attachments/4224391a-76ad-45d2-b53e-35e6b2cbab2e => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:16:37.667202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=28 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:16:37.667945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:16:37.672347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-73eeb6f4-cd58-4159-8409-f8dabb77225a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:16:37.678119 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73eeb6f4-cd58-4159-8409-f8dabb77225a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:37.678603 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73eeb6f4-cd58-4159-8409-f8dabb77225a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:37.681178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-73eeb6f4-cd58-4159-8409-f8dabb77225a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:37.738649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-73eeb6f4-cd58-4159-8409-f8dabb77225a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Going to try to stop instance {{(pid=127608) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 05 15:16:37.944818 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-73eeb6f4-cd58-4159-8409-f8dabb77225a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action" status: 202 len: 0 microversion: 2.1 time: 0.279061 Sep 05 15:16:37.945339 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1933/3728] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 15:16:37 2022] POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action => generated 0 bytes in 281 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:16:37.953942 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:37.954643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:37.961353 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:37.961870 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:37.962308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:37.963025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:37.963483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:37.963904 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:38.097309 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:38.105225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-84d0798e-fbe2-4528-bdcb-29a4aae25a9f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.155487 Sep 05 15:16:38.105778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1796/3729] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:37 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:39.131172 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:39.132024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:39.139026 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:39.139534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:39.139964 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:39.140647 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:39.141096 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:39.141635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:39.269109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:39.276718 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-af70549a-5827-4a93-aabb-2dd2460abbfe tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.150518 Sep 05 15:16:39.277286 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1934/3730] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:39 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:40.300132 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:40.300743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:40.303462 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:16:40.303637 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 (ip 10.222.0.15) !!! Sep 05 15:16:40.304680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:16:40.304818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:16:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 (ip 10.222.0.15) !!! Sep 05 15:16:40.314540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:40.315032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:40.315470 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:40.316154 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:40.316605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:40.317026 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:40.446226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:40.454275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3fba2510-ce9b-4632-a780-02d11b73a40b tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.158695 Sep 05 15:16:40.454861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1797/3731] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:40 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:41.477518 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:41.478152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:41.480668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:16:41.480807 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 (ip 10.222.0.15) !!! Sep 05 15:16:41.482137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:16:41.482256 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:16:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 (ip 10.222.0.15) !!! Sep 05 15:16:41.493501 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:41.493980 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:41.494409 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:41.495120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:41.495565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:41.495982 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:41.621990 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:41.629594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7c4c9ec8-89ab-4550-bae3-93b98e9a1c86 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.155871 Sep 05 15:16:41.630152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1935/3732] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:41 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:42.653013 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:42.653575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:42.659929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:42.660403 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:42.660834 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:42.661507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:42.661953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:42.662370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:42.789076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:42.797344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-867e3162-c832-49ee-9a8d-0725ef43384e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.148281 Sep 05 15:16:42.797913 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1798/3733] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:42 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:16:43.820954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:43.821557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:43.827862 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:43.828338 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:43.828765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:43.829444 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:43.829891 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:43.830306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:43.958461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:43.966052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2ecbfe60-7a05-44c4-8b9c-73ce517cd071 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.148978 Sep 05 15:16:43.966617 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1936/3734] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:43 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:44.988492 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:44.989099 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:44.995473 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:44.995953 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:44.996388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:44.997063 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:44.997513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:44.997931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:45.123732 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:45.131186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-44403443-62c5-4028-8282-edbe4457971a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.146581 Sep 05 15:16:45.131745 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1799/3735] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:44 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:46.154480 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:46.155612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:46.161724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:46.162205 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:46.162639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:46.163352 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:46.163806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:46.164232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:46.295304 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:46.303573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fa1e6944-f9d3-4574-b984-2dae386c43a5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.152927 Sep 05 15:16:46.304134 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1937/3736] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:46 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:47.325401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:47.326036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:47.333073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:47.333560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:47.333995 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:47.334680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:47.335168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:47.335599 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:47.461726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:47.469980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-5b59ebf4-e286-4036-b8f9-0cf8311540c0 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.148458 Sep 05 15:16:47.470541 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1800/3737] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:47 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:48.493220 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:48.493822 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:48.500302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:48.500781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:48.501210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:48.501885 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:48.502335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:48.502750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:48.640720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:48.648456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8a00f269-fd57-4176-b74d-1c34a6de5804 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1673 microversion: 2.1 time: 0.159038 Sep 05 15:16:48.655391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1938/3738] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:48 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1673 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:49.676850 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:49.677472 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:49.684120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:49.684621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:49.685373 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:49.685752 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:49.686875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:49.687308 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:49.816240 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:49.823973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3be963cc-5ef2-4e2d-a61a-a9a15d1fb7eb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1650 microversion: 2.1 time: 0.150934 Sep 05 15:16:49.824527 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1801/3739] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:49 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1650 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:49.846953 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-56a588e8-3294-427a-9258-19326a31b77c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:16:49.853519 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a588e8-3294-427a-9258-19326a31b77c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:49.854070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a588e8-3294-427a-9258-19326a31b77c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:49.854573 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-56a588e8-3294-427a-9258-19326a31b77c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:49.876408 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-56a588e8-3294-427a-9258-19326a31b77c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Going to try to start instance {{(pid=127608) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 05 15:16:50.038035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-56a588e8-3294-427a-9258-19326a31b77c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action" status: 202 len: 0 microversion: 2.1 time: 0.195018 Sep 05 15:16:50.038701 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1939/3740] 10.222.0.15 () {60 vars in 1278 bytes} [Mon Sep 5 15:16:49 2022] POST /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/action => generated 0 bytes in 197 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:16:50.046604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:50.047328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:50.053225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:50.053698 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:50.054126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:50.054823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:50.055272 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:50.055690 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:50.188085 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:50.194224 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8713a9e2-89c0-40a8-9331-dad373525d01 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1659 microversion: 2.1 time: 0.151346 Sep 05 15:16:50.194809 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1802/3741] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:50 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1659 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:51.218392 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:51.219696 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:51.225797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:51.232411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:51.232411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:51.232411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:51.232411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:51.232753 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:51.359912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:51.367436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e91e7f26-44fd-4a9e-9cc0-cdbda03e587f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1659 microversion: 2.1 time: 0.153702 Sep 05 15:16:51.367993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1940/3742] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:51 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1659 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:16:52.389786 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:16:52.390388 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:16:52.396957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:52.397501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:52.398015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:52.398731 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:16:52.399220 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:16:52.399643 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:16:52.526542 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:16:52.534760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2f137e45-f73e-4d7d-b78e-746d5a9a2e14 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1663 microversion: 2.1 time: 0.148861 Sep 05 15:16:52.535349 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1803/3743] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:16:52 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1663 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:02.347456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:02.347935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:02.350490 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=16 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:17:02.351200 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:17:02.355894 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:02.356380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:02.357628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:02.357628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:02.357961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:02.358389 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:02.372044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] HTTP exception thrown: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Request method failure captured: Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 HTTP/1.1 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjxpzpwMCpWynQ6Zzh2snM7i91iUuxPmwJ6l97SKoPyr2fqdnkoGbip3271V04G-WxY00hgnXsFWHQGH6HK7z6SzFkdGMi74ICNbLBLo0GuUq_pjj_TMAEkD-N1zYKXbHnn0qIziX0u1PB07rTEPKOSEdKoGr4h-EOYJPWm2A18mKY Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:17:02.373797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_834730ab3cfd4d649fc270843d47b291"}]}] Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 91c691b6a7724d708bfc7424908516c8 Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.375832 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': 'f13ef78b-3501-4ec5-b8d3-ec4363e1a635'} Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:17:02.376777 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.378159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.379525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Returning 404 to user: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:17:02.379525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-92437ceb-0d95-49bc-b4e4-f34146812bd8 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 404 len: 111 microversion: 2.20 time: 0.031597 Sep 05 15:17:02.379525 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1941/3744] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 5 15:17:02 2022] DELETE /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 15:17:02.384600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:02.386322 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: f13ef78b-3501-4ec5-b8d3-ec4363e1a635] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:02.392493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:02.392969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:02.393401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:02.394083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:02.394534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:02.394984 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:02.408771 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] HTTP exception thrown: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Request method failure captured: Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 HTTP/1.1 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjxpzpwMCpWynQ6Zzh2snM7i91iUuxPmwJ6l97SKoPyr2fqdnkoGbip3271V04G-WxY00hgnXsFWHQGH6HK7z6SzFkdGMi74ICNbLBLo0GuUq_pjj_TMAEkD-N1zYKXbHnn0qIziX0u1PB07rTEPKOSEdKoGr4h-EOYJPWm2A18mKY Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:17:02.410433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_834730ab3cfd4d649fc270843d47b291"}]}] Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 91c691b6a7724d708bfc7424908516c8 Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.411921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': 'f13ef78b-3501-4ec5-b8d3-ec4363e1a635'} Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:17:02.412838 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. Sep 05 15:17:02.414273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:02.415818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Returning 404 to user: Instance f13ef78b-3501-4ec5-b8d3-ec4363e1a635 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:17:02.415818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb86e483-301c-480c-bb0f-0a23a948372b tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635" status: 404 len: 111 microversion: 2.20 time: 0.031553 Sep 05 15:17:02.415818 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1804/3745] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:17:02 2022] GET /compute/v2.1/servers/f13ef78b-3501-4ec5-b8d3-ec4363e1a635 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 05 15:17:48.044228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:48.046492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:48.054315 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:48.054816 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:48.055250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:48.055933 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:48.056384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:48.056805 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:48.086113 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-19ff408a-a5a9-4875-a68a-979e36a4d958 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045787 Sep 05 15:17:48.086663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1942/3746] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 15:17:48 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 15:17:48.149681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:48.150175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:48.152345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=20 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:17:48.153087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=59,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:17:48.157526 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:48.158001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:48.158430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:48.159186 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:48.165549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:48.165549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:48.187249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Going to try to terminate instance {{(pid=127609) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:17:48.445560 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-821ea5ff-affe-4867-a2a8-cbc46d1698c1 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 204 len: 0 microversion: 2.1 time: 0.299390 Sep 05 15:17:48.446144 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1805/3747] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:17:48 2022] DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:17:48.454493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:48.455789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:48.462237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:48.462724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:48.468135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:48.468135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:48.468135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:48.468135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:48.591247 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:48.598728 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-2fef00d2-8a47-4da4-bfad-1f41978c77d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1669 microversion: 2.1 time: 0.148231 Sep 05 15:17:48.599302 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1943/3748] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:48 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1669 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:49.621604 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:49.622356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:49.628847 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:49.629331 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:49.629770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:49.630461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:49.630947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:49.631375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:49.763069 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:49.770662 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-311fcd54-1819-4ccb-ada4-b09454729b1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1669 microversion: 2.1 time: 0.153349 Sep 05 15:17:49.771254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1806/3749] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:49 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1669 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:50.793545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:50.794188 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:50.801127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:50.801607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:50.802039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:50.802731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:50.803211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:50.803635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:50.930841 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:50.938493 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7cb8d514-d4c4-416b-948e-91861aff2b90 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1669 microversion: 2.1 time: 0.148926 Sep 05 15:17:50.939095 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1944/3750] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:50 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1669 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:51.679067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-65d01276-0dae-4fc6-a01e-885991121b0f req-eb174b9e-453b-4f8e-8354-f766b600054c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "32dac823-da0b-4b04-9a66-2ac2dc469b90", "name": "network-vif-deleted", "tag": "4ecd287f-a5a1-4f21-82cd-e5d3a622004b"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:17:51.689991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-65d01276-0dae-4fc6-a01e-885991121b0f req-eb174b9e-453b-4f8e-8354-f766b600054c service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:51.690434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-65d01276-0dae-4fc6-a01e-885991121b0f req-eb174b9e-453b-4f8e-8354-f766b600054c service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:51.690894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-65d01276-0dae-4fc6-a01e-885991121b0f req-eb174b9e-453b-4f8e-8354-f766b600054c service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:51.702494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-65d01276-0dae-4fc6-a01e-885991121b0f req-eb174b9e-453b-4f8e-8354-f766b600054c service nova] Creating event network-vif-deleted:4ecd287f-a5a1-4f21-82cd-e5d3a622004b for instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 on hv-cinder-84290 Sep 05 15:17:51.708436 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-65d01276-0dae-4fc6-a01e-885991121b0f req-eb174b9e-453b-4f8e-8354-f766b600054c service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034822 Sep 05 15:17:51.714193 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1807/3751] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:17:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 15:17:51.961472 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:51.962946 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:51.969912 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:51.970607 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:51.970877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:51.971554 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:51.972006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:51.972428 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:52.006436 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:52.006880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:52.007318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:52.007765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lazy-loading 'fault' on Instance uuid 32dac823-da0b-4b04-9a66-2ac2dc469b90 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:17:52.053662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:52.063222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4793b0ca-1851-4455-b14a-9f109077c4c4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 200 len: 1325 microversion: 2.1 time: 0.105518 Sep 05 15:17:52.064003 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1945/3752] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:51 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 1325 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:53.090612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:53.091587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:53.100626 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:53.101290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:53.101893 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:53.102898 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:53.103546 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:53.104146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:53.119962 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] HTTP exception thrown: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Request method failure captured: Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 HTTP/1.1 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhIW5Oe5wAA3P7ZLgTP9gtecU1r-0JbjAGAe5RTqDGFSJyG7ceL0WWC21ea0-U90mv9-5-1SgeuRm37inJp0atHmF1LiixU60XQeKg47lGt001whPZxfb8KzZFEBF4KPzuHJxQfyiHB3s2DcHCyXetQDhq7B_0L5qiGBcU3XFPfyNJ0 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:17:53.121554 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7c858eb651e44140960444974d8bc4c4"}]}] Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 3ad73a36c45a4763b00027457fb4117f Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:17:53.123006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '32dac823-da0b-4b04-9a66-2ac2dc469b90'} Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:17:53.123865 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:17:53.125181 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:17:53.126354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Returning 404 to user: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:17:53.126354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9b464817-161d-4aae-979b-5b5b7e1b03d4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 404 len: 111 microversion: 2.1 time: 0.038154 Sep 05 15:17:53.126354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1808/3753] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:53 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:17:53.133203 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7d0403b6-470b-4120-b9fb-d1287cf15789 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '.version_select at 0x7fb191580550>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:53.207424 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7d0403b6-470b-4120-b9fb-d1287cf15789 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-42259484" status: 202 len: 0 microversion: 2.1 time: 0.078890 Sep 05 15:17:53.208042 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1946/3754] 10.222.0.15 () {58 vars in 1215 bytes} [Mon Sep 5 15:17:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-42259484 => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:17:54.148789 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-77ef9779-ddbe-408f-89b7-e869ff79c013 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: .version_select at 0x7fb194ca11f0>, body: {"keypair": {"name": "tempest-keypair-1319007246", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF5k2+p1Z/FraPPb6Rl9BQwqs4kDE8SQHQfapNLl0yqtiN3qOh7IFXaYQMMe1y4zM50vXye+DtKh03FTfrtgYe0iyxc7MEJlGSycKgSostgxhRe0/Tcn2eczJYEmykqqDQ=="}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:17:54.165213 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-77ef9779-ddbe-408f-89b7-e869ff79c013 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for project 7c858eb651e44140960444974d8bc4c4. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:17:54.168999 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-77ef9779-ddbe-408f-89b7-e869ff79c013 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for user 3ad73a36c45a4763b00027457fb4117f and project 7c858eb651e44140960444974d8bc4c4. Resources: {'key_pairs'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:17:54.263987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-77ef9779-ddbe-408f-89b7-e869ff79c013 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.119456 Sep 05 15:17:54.264593 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1809/3755] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 15:17:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:17:56.461697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-104087843", "imageRef": "92e1b94c-b234-4052-847b-b405b16c4ac6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "443ae9fa-3bc9-4152-85eb-d266473db248"}], "security_groups": [{"name": "tempest-securitygroup--1127198939"}], "key_name": "tempest-keypair-1319007246", "user_data": "}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:17:56.565492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.network.neutron [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] validate_networks() for [('443ae9fa-3bc9-4152-85eb-d266473db248', None, None, None, None, None)] {{(pid=127608) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 15:17:56.936317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Flavor limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 15:17:56.936746 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Image limits 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 15:17:56.937228 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Flavor pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 15:17:56.937640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Image pref 0:0:0 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 15:17:56.938059 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.virt.hardware [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127608) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 15:17:56.947454 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:56.947936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:56.948375 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:56.949098 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:56.949557 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:56.949985 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:56.966385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for project 7c858eb651e44140960444974d8bc4c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:17:56.970381 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Getting quotas for user 3ad73a36c45a4763b00027457fb4117f and project 7c858eb651e44140960444974d8bc4c4. Resources: {'cores', 'instances', 'ram'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:17:56.981272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Going to run 1 instances... {{(pid=127608) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 15:17:56.983566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='92e1b94c-b234-4052-847b-b405b16c4ac6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127608) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 15:17:57.145167 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5f9174ab-8361-41e3-9c64-99f687cfde5f tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.688454 Sep 05 15:17:57.145817 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1947/3756] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 15:17:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 690 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 15:17:57.157452 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-95e13d17-d531-473e-b54e-5358c03b8d1e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:57.158053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-95e13d17-d531-473e-b54e-5358c03b8d1e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:57.216310 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-95e13d17-d531-473e-b54e-5358c03b8d1e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:57.223769 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-95e13d17-d531-473e-b54e-5358c03b8d1e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1237 microversion: 2.1 time: 0.070757 Sep 05 15:17:57.224425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1810/3757] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:57 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1237 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:58.247689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:58.248299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:58.256925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:58.257419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:58.257854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:58.258547 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:58.259303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:58.259726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:58.322207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:58.330163 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4ac8d57a-b4f4-47fc-8d6a-5c2ab455cdcb tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1241 microversion: 2.1 time: 0.086798 Sep 05 15:17:58.330738 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1948/3758] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:58 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:17:59.354006 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:17:59.354600 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:17:59.361191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:59.361747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:59.362247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:59.363045 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:17:59.363587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:17:59.364080 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:17:59.427047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:17:59.434776 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-0dd9cfb4-38b3-4a97-891b-73ff6cc09839 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1295 microversion: 2.1 time: 0.084853 Sep 05 15:17:59.435371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1811/3759] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:17:59 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1295 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:00.458070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:00.458876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:00.465395 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:00.465961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:00.466466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:00.467281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:00.467806 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:00.468298 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:00.605671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:00.615676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-27e3078b-f4a3-4c40-941d-0b968c6af6d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.159171 Sep 05 15:18:00.615676 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1949/3760] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:00 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:01.048564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-de04ca1d-3807-4a43-af40-12620ac1b639 req-fb8c3308-ac95-44d1-ab51-e51a18e05f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967a8c54-6d43-471a-9eaa-e5f3ecbdd514", "tag": "d79ed321-469f-463f-bf8f-28d46a4fc551"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:18:01.058808 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-de04ca1d-3807-4a43-af40-12620ac1b639 req-fb8c3308-ac95-44d1-ab51-e51a18e05f9d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:01.059277 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-de04ca1d-3807-4a43-af40-12620ac1b639 req-fb8c3308-ac95-44d1-ab51-e51a18e05f9d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:01.059701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-de04ca1d-3807-4a43-af40-12620ac1b639 req-fb8c3308-ac95-44d1-ab51-e51a18e05f9d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:01.073172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-de04ca1d-3807-4a43-af40-12620ac1b639 req-fb8c3308-ac95-44d1-ab51-e51a18e05f9d service nova] Creating event network-changed:d79ed321-469f-463f-bf8f-28d46a4fc551 for instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 on hv-cinder-84290 Sep 05 15:18:01.078416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-de04ca1d-3807-4a43-af40-12620ac1b639 req-fb8c3308-ac95-44d1-ab51-e51a18e05f9d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034688 Sep 05 15:18:01.079225 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1812/3761] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:18:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:18:01.636028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:01.636639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:01.643027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:01.643511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:01.643942 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:01.644655 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:01.645102 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:01.645521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:01.774803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:01.782665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-14bbeb58-ef49-4c1e-a80e-9e0f79150747 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.150737 Sep 05 15:18:01.783825 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1950/3762] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:01 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:02.806564 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:02.807275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:02.814168 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:02.814645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:02.815117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:02.815827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:02.816922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:02.817345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:02.948015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:02.955780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f47b257b-678f-463b-a3f6-24db9456d0ba tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.153472 Sep 05 15:18:02.956354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1813/3763] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:02 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:03.978242 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:03.978878 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:03.985246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:03.985726 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:03.986159 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:03.986860 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:03.987316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:03.987737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:04.115916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:04.123461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ab84685e-6f5e-402c-9589-8c7e0bce7cdd tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.149081 Sep 05 15:18:04.124020 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1951/3764] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:03 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:05.146866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:05.147513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:05.154414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:05.154936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:05.155378 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:05.156074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:05.156531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:05.156958 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:05.284410 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:05.292994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9c812456-0697-4def-8c7f-78eb1e2381ee tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.150406 Sep 05 15:18:05.293566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1814/3765] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:05 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:06.315445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:06.316047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:06.322689 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:06.323201 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:06.323633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:06.324343 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:06.324793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:06.325214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:06.463927 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:06.471711 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3ff3a5b8-ea18-4fce-af4a-f8955bb3cc26 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.160200 Sep 05 15:18:06.472281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1952/3766] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:06 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:07.494710 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:07.495305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:07.497390 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:18:07.502095 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:07.502575 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:07.503059 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:07.503741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:07.504192 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:07.504613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:07.631434 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:07.639238 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ccd32203-2c99-4293-8af1-20ef35629c51 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.148417 Sep 05 15:18:07.639801 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1815/3767] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:07 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:08.588560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-12e64d2d-5f86-4d53-b8e2-5838a09dfad8 req-294f4aa9-10b9-4f23-9bc2-8fa6432f798b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967a8c54-6d43-471a-9eaa-e5f3ecbdd514", "name": "network-vif-plugged", "status": "completed", "tag": "d79ed321-469f-463f-bf8f-28d46a4fc551"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:18:08.593537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:18:08.594092 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=6 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:18:08.599774 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-12e64d2d-5f86-4d53-b8e2-5838a09dfad8 req-294f4aa9-10b9-4f23-9bc2-8fa6432f798b service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:08.600253 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-12e64d2d-5f86-4d53-b8e2-5838a09dfad8 req-294f4aa9-10b9-4f23-9bc2-8fa6432f798b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:08.600683 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-12e64d2d-5f86-4d53-b8e2-5838a09dfad8 req-294f4aa9-10b9-4f23-9bc2-8fa6432f798b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:08.613207 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-12e64d2d-5f86-4d53-b8e2-5838a09dfad8 req-294f4aa9-10b9-4f23-9bc2-8fa6432f798b service nova] Creating event network-vif-plugged:d79ed321-469f-463f-bf8f-28d46a4fc551 for instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 on hv-cinder-84290 Sep 05 15:18:08.618311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-12e64d2d-5f86-4d53-b8e2-5838a09dfad8 req-294f4aa9-10b9-4f23-9bc2-8fa6432f798b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033513 Sep 05 15:18:08.618935 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1953/3768] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:18:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:18:08.661694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:08.662139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:08.670602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:08.671493 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:08.671912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:08.673126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:08.673762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:08.674194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:08.814242 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:08.822664 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9a7a55b7-8da7-4f43-acc4-eda96e540a25 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.165111 Sep 05 15:18:08.823262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1816/3769] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:08 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:09.847224 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:09.847926 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:09.855399 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:09.855880 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:09.856320 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:09.856998 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:09.857455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:09.857883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:09.983925 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:09.992035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-48e09f9c-ac25-4175-a45d-bb17a8e990c5 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1363 microversion: 2.1 time: 0.149865 Sep 05 15:18:09.992591 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1954/3770] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:09 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:11.014450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:11.015108 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:11.022172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:11.022674 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:11.023130 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:11.023807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:11.024253 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:11.024671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:11.153568 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:18:11.161190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f15006fb-f85f-49e7-be54-f42229ff2a4e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1548 microversion: 2.1 time: 0.150534 Sep 05 15:18:11.161747 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1817/3771] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:18:11 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:18:11.183437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:18:11.183910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:18:11.190249 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:11.190724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:11.191193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:11.191869 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:11.192954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:11.193374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:11.269136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-83f08d9a-7aff-470e-aa6a-f5484789a45a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089556 Sep 05 15:18:11.269721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1955/3772] 10.222.0.15 () {58 vars in 1275 bytes} [Mon Sep 5 15:18:11 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:18:12.354152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-b58cf7da-0b24-4ce4-8f27-5ce5c157a125 req-c2bba66f-e636-4884-8b68-cc28e259e82e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "967a8c54-6d43-471a-9eaa-e5f3ecbdd514", "tag": "d79ed321-469f-463f-bf8f-28d46a4fc551"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:18:12.363513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b58cf7da-0b24-4ce4-8f27-5ce5c157a125 req-c2bba66f-e636-4884-8b68-cc28e259e82e service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:18:12.364602 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b58cf7da-0b24-4ce4-8f27-5ce5c157a125 req-c2bba66f-e636-4884-8b68-cc28e259e82e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:18:12.365035 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b58cf7da-0b24-4ce4-8f27-5ce5c157a125 req-c2bba66f-e636-4884-8b68-cc28e259e82e service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:18:12.376700 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-b58cf7da-0b24-4ce4-8f27-5ce5c157a125 req-c2bba66f-e636-4884-8b68-cc28e259e82e service nova] Creating event network-changed:d79ed321-469f-463f-bf8f-28d46a4fc551 for instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 on hv-cinder-84290 Sep 05 15:18:12.381965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-b58cf7da-0b24-4ce4-8f27-5ce5c157a125 req-c2bba66f-e636-4884-8b68-cc28e259e82e service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.151671 Sep 05 15:18:12.382922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1818/3773] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:18:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:25.047367 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=46,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:25.048146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=72 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:25.118397 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:25.118973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:25.125237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:25.128391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:25.128391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:25.128391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:25.128391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:25.128719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:25.152552 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-99f39d43-d644-46d5-bfe5-f27c4e3d8297 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/ips" status: 200 len: 144 microversion: 2.1 time: 0.107583 Sep 05 15:19:25.153106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1956/3774] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 15:19:25 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/ips => generated 144 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:27.800878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:27.801630 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:27.805935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "017a2980-2c34-404a-ba6a-9fd3c3541ae0"}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:19:27.808820 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:27.815047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:27.822667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:27.822667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:27.822667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:27.822667 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:27.823097 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:28.458986 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-105cd63a-d084-49e0-ab6e-54f434522527 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660520 Sep 05 15:19:28.459661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1819/3775] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 15:19:27 2022] POST /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:35.984680 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:35.986939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:35.989248 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=4 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:35.994152 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:35.994628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:35.995090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:35.995826 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:35.996277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:35.996697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:36.025750 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5d045ca4-6f6e-42a9-8bfe-64bc7af25503 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044666 Sep 05 15:19:36.026291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1957/3776] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 15:19:35 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:36.038826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:36.039401 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:36.046548 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:36.051832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:36.051832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:36.051832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:36.051832 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:36.052250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:36.077467 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d2d088ae-6d1e-4174-b5ce-ccaf81e0aa65 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/017a2980-2c34-404a-ba6a-9fd3c3541ae0" status: 200 len: 194 microversion: 2.1 time: 0.043021 Sep 05 15:19:36.078062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1820/3777] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Sep 5 15:19:36 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/017a2980-2c34-404a-ba6a-9fd3c3541ae0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:37.693581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77f1d329-c08f-42d5-889d-8e7bdef0ebb4"}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:19:37.695981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:37.703378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:37.703855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:37.704282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:37.704951 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:37.705398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:37.705813 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:38.316066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9e26f5fa-fa65-4c9a-b073-6225278137b9 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "POST /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.626620 Sep 05 15:19:38.316662 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1958/3778] 10.222.0.15 () {60 vars in 1323 bytes} [Mon Sep 5 15:19:37 2022] POST /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments => generated 194 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:45.843323 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:45.845471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:45.852357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:45.852840 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:45.853797 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:45.855252 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:45.856136 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:45.856562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:45.887489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-c3869d77-d855-4411-8a61-ab86777f042c tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048105 Sep 05 15:19:45.888038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1821/3779] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 15:19:45 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:46.029460 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:46.030027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:46.036137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:46.036609 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:46.037039 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:46.037724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:46.038169 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:46.038583 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:46.067417 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8b5fad64-ef3f-441d-809a-e7b3a1f55243 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/017a2980-2c34-404a-ba6a-9fd3c3541ae0" status: 200 len: 194 microversion: 2.1 time: 0.042855 Sep 05 15:19:46.067909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1959/3780] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Sep 5 15:19:46 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/017a2980-2c34-404a-ba6a-9fd3c3541ae0 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:46.078008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:46.078494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:46.084338 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:46.084817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:46.085246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:46.085921 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:46.086368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:46.086810 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:46.164415 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lazy-loading 'services' on Instance uuid 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:19:46.362143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83c2cca8-bd6b-43fd-8fb3-40fa94fed405 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/017a2980-2c34-404a-ba6a-9fd3c3541ae0" status: 202 len: 0 microversion: 2.1 time: 0.287727 Sep 05 15:19:46.362680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1822/3781] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 15:19:46 2022] DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/017a2980-2c34-404a-ba6a-9fd3c3541ae0 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:19:48.539484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:48.539971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:48.546427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:48.546966 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:48.547403 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:48.548084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:48.548542 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:48.548965 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:48.578052 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9a3778ba-425d-42a4-b8a4-279196ca8900 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/77f1d329-c08f-42d5-889d-8e7bdef0ebb4" status: 200 len: 194 microversion: 2.1 time: 0.042552 Sep 05 15:19:48.578622 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1960/3782] 10.222.0.15 () {58 vars in 1413 bytes} [Mon Sep 5 15:19:48 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/77f1d329-c08f-42d5-889d-8e7bdef0ebb4 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:48.590458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:48.591065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:48.597360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:48.597841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:48.598276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:48.598987 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:48.599443 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:48.599866 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:48.677878 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lazy-loading 'services' on Instance uuid 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:19:48.882255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-df90d51f-1b34-4c79-b873-4200690c581d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/77f1d329-c08f-42d5-889d-8e7bdef0ebb4" status: 202 len: 0 microversion: 2.1 time: 0.296336 Sep 05 15:19:48.882900 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1823/3783] 10.222.0.15 () {58 vars in 1416 bytes} [Mon Sep 5 15:19:48 2022] DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments/77f1d329-c08f-42d5-889d-8e7bdef0ebb4 => generated 0 bytes in 298 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:19:50.056024 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:50.058833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:50.065156 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.065640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.066076 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.066814 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.067277 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.067707 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.097124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d2d4edce-ebab-4a1a-a900-b3a97c68222a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044970 Sep 05 15:19:50.097713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1961/3784] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 15:19:50 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 15:19:50.215876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:50.218173 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:50.224671 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.225149 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.225581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.226258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.226708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.227153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.255354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9991e5a0-0df7-473f-90fa-22b6ad5c554d tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043714 Sep 05 15:19:50.255873 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1824/3785] 10.222.0.15 () {58 vars in 1302 bytes} [Mon Sep 5 15:19:50 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 05 15:19:50.317945 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:50.318485 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:50.324911 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.325393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.325829 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.326507 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.327016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.327441 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.351852 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:19:50.631327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3254e5cc-a6b9-4a5c-aac3-5ed6aa1426e7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 204 len: 0 microversion: 2.1 time: 0.316868 Sep 05 15:19:50.631909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1962/3786] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:19:50 2022] DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:19:50.640749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:50.641357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:50.647402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.650111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.650111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.650111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:50.650111 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:50.650422 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:50.785509 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:19:50.793912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-d1deb81b-aed8-49d4-892f-2a337e960749 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1672 microversion: 2.1 time: 0.156805 Sep 05 15:19:50.794770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1825/3787] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:19:50 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:19:51.818126 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:51.818849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:51.825263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:51.825749 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:51.826187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:51.826901 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:51.827360 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:51.827786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:51.958851 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:19:51.966486 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9547da76-ac88-413b-9bf9-4be877dfefae tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1672 microversion: 2.1 time: 0.152716 Sep 05 15:19:51.967073 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1963/3788] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:19:51 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1672 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:19:52.989829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:52.990374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:52.997029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:52.997506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:52.997936 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:52.998618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:52.999109 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:52.999530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:53.363065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:19:53.370806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-a519ab46-e93b-4463-8969-e1ba7c9fcc1a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1672 microversion: 2.1 time: 0.385008 Sep 05 15:19:53.371379 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1826/3789] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:19:52 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1672 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:19:53.872821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-8d92fef7-0b15-42bd-b4ce-3ef91a49af37 req-a2e9ba49-6c2e-4feb-9f04-5467127354d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "967a8c54-6d43-471a-9eaa-e5f3ecbdd514", "name": "network-vif-deleted", "tag": "d79ed321-469f-463f-bf8f-28d46a4fc551"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:19:53.884804 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8d92fef7-0b15-42bd-b4ce-3ef91a49af37 req-a2e9ba49-6c2e-4feb-9f04-5467127354d0 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:53.885874 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8d92fef7-0b15-42bd-b4ce-3ef91a49af37 req-a2e9ba49-6c2e-4feb-9f04-5467127354d0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:53.886370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8d92fef7-0b15-42bd-b4ce-3ef91a49af37 req-a2e9ba49-6c2e-4feb-9f04-5467127354d0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:53.902387 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-8d92fef7-0b15-42bd-b4ce-3ef91a49af37 req-a2e9ba49-6c2e-4feb-9f04-5467127354d0 service nova] Creating event network-vif-deleted:d79ed321-469f-463f-bf8f-28d46a4fc551 for instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 on hv-cinder-84290 Sep 05 15:19:53.909035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-8d92fef7-0b15-42bd-b4ce-3ef91a49af37 req-a2e9ba49-6c2e-4feb-9f04-5467127354d0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098180 Sep 05 15:19:53.910157 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1964/3790] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:19:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:19:54.394404 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:54.394963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:54.401389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:54.401872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:54.402312 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:54.403058 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:54.403518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:54.403943 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:54.435613 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:54.436098 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:54.436533 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:54.436973 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lazy-loading 'fault' on Instance uuid 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:19:54.478482 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3ad73a36c45a4763b00027457fb4117f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7c858eb651e44140960444974d8bc4c4', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:19:54.487530 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f2b8a06e-d87a-43ad-8c28-0e2086bc4d55 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 200 len: 1327 microversion: 2.1 time: 0.097003 Sep 05 15:19:54.488191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1827/3791] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:19:54 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 1327 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:19:55.511691 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:55.512380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:55.518939 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:55.519414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:55.519842 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:55.520514 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:55.520963 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:55.521386 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:55.534144 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] HTTP exception thrown: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Request method failure captured: Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 HTTP/1.1 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhIW5Oe5wAA3P7ZLgTP9gtecU1r-0JbjAGAe5RTqDGFSJyG7ceL0WWC21ea0-U90mv9-5-1SgeuRm37inJp0atHmF1LiixU60XQeKg47lGt001whPZxfb8KzZFEBF4KPzuHJxQfyiHB3s2DcHCyXetQDhq7B_0L5qiGBcU3XFPfyNJ0 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:19:55.535758 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7c858eb651e44140960444974d8bc4c4"}]}] Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 3ad73a36c45a4763b00027457fb4117f Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:55.537211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '967a8c54-6d43-471a-9eaa-e5f3ecbdd514'} Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:19:55.538062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:55.539445 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:55.540651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Returning 404 to user: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:19:55.540651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e68fa4aa-c7df-4ac6-93a7-00b1c963193a tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 404 len: 111 microversion: 2.1 time: 0.030498 Sep 05 15:19:55.540651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1965/3792] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:19:55 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:19:55.546133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1258cd23-8b68-4f4f-979d-35182afe698e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '.version_select at 0x7fb194d3d700>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:55.609275 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1258cd23-8b68-4f4f-979d-35182afe698e tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319007246" status: 202 len: 0 microversion: 2.1 time: 0.066842 Sep 05 15:19:55.609819 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1828/3793] 10.222.0.15 () {58 vars in 1221 bytes} [Mon Sep 5 15:19:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1319007246 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 05 15:19:58.792709 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:58.793229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:58.799719 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:58.800204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:58.800641 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:58.801318 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:58.801770 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:58.802189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:58.815233 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] HTTP exception thrown: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Request method failure captured: Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 HTTP/1.1 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhIW5Oe5wAA3P7ZLgTP9gtecU1r-0JbjAGAe5RTqDGFSJyG7ceL0WWC21ea0-U90mv9-5-1SgeuRm37inJp0atHmF1LiixU60XQeKg47lGt001whPZxfb8KzZFEBF4KPzuHJxQfyiHB3s2DcHCyXetQDhq7B_0L5qiGBcU3XFPfyNJ0 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:19:58.816757 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7c858eb651e44140960444974d8bc4c4"}]}] Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 3ad73a36c45a4763b00027457fb4117f Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.818124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '967a8c54-6d43-471a-9eaa-e5f3ecbdd514'} Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:19:58.818979 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.820269 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.821577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Returning 404 to user: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:19:58.821577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-4cf5520a-ff45-46eb-85db-94e9159dad19 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 404 len: 111 microversion: 2.1 time: 0.029305 Sep 05 15:19:58.821577 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1966/3794] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:19:58 2022] DELETE /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:19:58.827725 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:19:58.828366 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 967a8c54-6d43-471a-9eaa-e5f3ecbdd514] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:19:58.830274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=24,nova_api:DELETE=1 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:58.835585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:58.836068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:58.836501 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:58.837189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:19:58.837639 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:19:58.838062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:19:58.842650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:19:58.851450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] HTTP exception thrown: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Request method failure captured: Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 HTTP/1.1 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhIW5Oe5wAA3P7ZLgTP9gtecU1r-0JbjAGAe5RTqDGFSJyG7ceL0WWC21ea0-U90mv9-5-1SgeuRm37inJp0atHmF1LiixU60XQeKg47lGt001whPZxfb8KzZFEBF4KPzuHJxQfyiHB3s2DcHCyXetQDhq7B_0L5qiGBcU3XFPfyNJ0 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:19:58.853046 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7c858eb651e44140960444974d8bc4c4"}]}] Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 3ad73a36c45a4763b00027457fb4117f Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.854406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '967a8c54-6d43-471a-9eaa-e5f3ecbdd514'} Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:19:58.855330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. Sep 05 15:19:58.856714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:19:58.857976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Returning 404 to user: Instance 967a8c54-6d43-471a-9eaa-e5f3ecbdd514 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:19:58.857976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2048795f-a1a0-45f3-bbb0-a2173b5269a4 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514" status: 404 len: 111 microversion: 2.1 time: 0.031742 Sep 05 15:19:58.857976 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1829/3795] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:19:58 2022] GET /compute/v2.1/servers/967a8c54-6d43-471a-9eaa-e5f3ecbdd514 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:20:00.129374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:20:00.129865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:20:00.136884 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:20:00.137359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:20:00.137789 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:20:00.138462 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:20:00.138941 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:20:00.139362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:20:00.152977 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] HTTP exception thrown: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Request method failure captured: Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 HTTP/1.1 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhIW5Oe5wAA3P7ZLgTP9gtecU1r-0JbjAGAe5RTqDGFSJyG7ceL0WWC21ea0-U90mv9-5-1SgeuRm37inJp0atHmF1LiixU60XQeKg47lGt001whPZxfb8KzZFEBF4KPzuHJxQfyiHB3s2DcHCyXetQDhq7B_0L5qiGBcU3XFPfyNJ0 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:20:00.154488 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7c858eb651e44140960444974d8bc4c4"}]}] Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 3ad73a36c45a4763b00027457fb4117f Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.156745 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '32dac823-da0b-4b04-9a66-2ac2dc469b90'} Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:20:00.157970 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.160127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.162549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Returning 404 to user: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:20:00.162549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9e826c80-4d46-4071-b132-29507aa8ac67 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 404 len: 111 microversion: 2.1 time: 0.030801 Sep 05 15:20:00.162549 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1967/3796] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:20:00 2022] DELETE /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:20:00.165663 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:20:00.166274 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] [instance: 32dac823-da0b-4b04-9a66-2ac2dc469b90] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:20:00.173967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:20:00.174446 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:20:00.174983 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:20:00.175691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:20:00.176128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:20:00.176553 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:20:00.189394 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] HTTP exception thrown: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Request method failure captured: Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 HTTP/1.1 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhIW5Oe5wAA3P7ZLgTP9gtecU1r-0JbjAGAe5RTqDGFSJyG7ceL0WWC21ea0-U90mv9-5-1SgeuRm37inJp0atHmF1LiixU60XQeKg47lGt001whPZxfb8KzZFEBF4KPzuHJxQfyiHB3s2DcHCyXetQDhq7B_0L5qiGBcU3XFPfyNJ0 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:20:00.191249 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/7c858eb651e44140960444974d8bc4c4"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_7c858eb651e44140960444974d8bc4c4"}]}] Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 7c858eb651e44140960444974d8bc4c4 Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeTestJSON-444549511 Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 3ad73a36c45a4763b00027457fb4117f Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeTestJSON-444549511-project Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.192605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '32dac823-da0b-4b04-9a66-2ac2dc469b90'} Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:20:00.193278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. Sep 05 15:20:00.194304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:20:00.195260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] Returning 404 to user: Instance 32dac823-da0b-4b04-9a66-2ac2dc469b90 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:20:00.195260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4872a2aa-5601-4313-bcab-86aa3b2f89d7 tempest-AttachVolumeTestJSON-444549511 tempest-AttachVolumeTestJSON-444549511-project] 10.222.0.15 "GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90" status: 404 len: 111 microversion: 2.1 time: 0.031644 Sep 05 15:20:00.195260 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1830/3797] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:20:00 2022] GET /compute/v2.1/servers/32dac823-da0b-4b04-9a66-2ac2dc469b90 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:23:02.892173 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:23:02.892904 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=29,nova_api:UPDATE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:23:02.893623 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:23:02.894534 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:23:02.894681 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 15:23:02.895902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:23:02.896019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 15:23:02.897279 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:23:02.897385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 15:23:02.902461 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:23:02.902971 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:23:02.919602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:23:02.920084 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:23:02.920517 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:23:02.921198 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:23:02.921653 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:23:02.922074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:23:02.937732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] HTTP exception thrown: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Request method failure captured: Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 HTTP/1.1 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFgjxpzpwMCpWynQ6Zzh2snM7i91iUuxPmwJ6l97SKoPyr2fqdnkoGbip3271V04G-WxY00hgnXsFWHQGH6HK7z6SzFkdGMi74ICNbLBLo0GuUq_pjj_TMAEkD-N1zYKXbHnn0qIziX0u1PB07rTEPKOSEdKoGr4h-EOYJPWm2A18mKY Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:23:02.939928 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_834730ab3cfd4d649fc270843d47b291"}]}] Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 91c691b6a7724d708bfc7424908516c8 Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.941378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '6f82e417-b9d8-47c8-b4da-32b0c5d2b166'} Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:02.942079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.943497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.944978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Returning 404 to user: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:02.944978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6ad87ac7-e5f6-4408-a9d9-3f6d8456151c tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 404 len: 111 microversion: 2.20 time: 0.051188 Sep 05 15:23:02.944978 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1968/3798] 10.222.0.15 () {60 vars in 1280 bytes} [Mon Sep 5 15:23:02 2022] DELETE /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 05 15:23:02.948656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:23:02.949411 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:23:02.949552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 15:23:02.950831 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:23:02.950957 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 15:23:02.952287 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:23:02.952412 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:23:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 (ip 10.222.0.15) !!! Sep 05 15:23:02.956758 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:23:02.957357 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] [instance: 6f82e417-b9d8-47c8-b4da-32b0c5d2b166] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:23:02.975773 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:23:02.976281 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:23:02.976767 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:23:02.977739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:23:02.978190 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:23:02.978607 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:23:02.991963 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] HTTP exception thrown: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Request method failure captured: Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 HTTP/1.1 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFgjxpzpwMCpWynQ6Zzh2snM7i91iUuxPmwJ6l97SKoPyr2fqdnkoGbip3271V04G-WxY00hgnXsFWHQGH6HK7z6SzFkdGMi74ICNbLBLo0GuUq_pjj_TMAEkD-N1zYKXbHnn0qIziX0u1PB07rTEPKOSEdKoGr4h-EOYJPWm2A18mKY Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Openstack-Nova-Api-Version: 2.20 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:23:02.993513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/834730ab3cfd4d649fc270843d47b291"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_834730ab3cfd4d649fc270843d47b291"}]}] Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 834730ab3cfd4d649fc270843d47b291 Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1617823980 Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 91c691b6a7724d708bfc7424908516c8 Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1617823980-project Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.995067 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '6f82e417-b9d8-47c8-b4da-32b0c5d2b166'} Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:02.995876 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. Sep 05 15:23:02.997271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:02.998444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] Returning 404 to user: Instance 6f82e417-b9d8-47c8-b4da-32b0c5d2b166 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:02.998444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-196e1838-c0d5-499f-bf0c-75f8b7d1db39 tempest-AttachVolumeShelveTestJSON-1617823980 tempest-AttachVolumeShelveTestJSON-1617823980-project] 10.222.0.15 "GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166" status: 404 len: 111 microversion: 2.20 time: 0.048915 Sep 05 15:23:02.998444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1831/3799] 10.222.0.15 () {60 vars in 1277 bytes} [Mon Sep 5 15:23:02 2022] GET /compute/v2.1/servers/6f82e417-b9d8-47c8-b4da-32b0c5d2b166 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 05 15:23:08.405934 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 58608. Sep 05 15:23:08.507511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbc326f6-3a4e-4233-97e4-94f22c587100 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Action: 'create', calling method: .version_select at 0x7fb194b940d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-368700325", "metadata": {"Type": "work"}}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbc326f6-3a4e-4233-97e4-94f22c587100 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Request method failure captured: Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 121 Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhRcebp8Jr7QR-TjZ4w50aswuwuuIj7Egp99eCmwvcBrF3XrUNHU5YRZmMe_08DvoU2Aj_GXN6aMh60WzBwGY8YUtQXm4P_6NsQM5mbOFHB6daC1FKdc45xHbV1wN739ndGXlr_e4QZOuYjQluytTJpBNnJrRk4EPMDVAZqqeZEPvEI Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:23:08.520363 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb5447bb1f444ff1a5de329c02db774b"}]}] Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c038f043eda14202b4d5594b51027220 Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-368700325", "metadata": {"Type": "work"}}} Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: Sep 05 15:23:08.521833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-368700325', 'metadata': {'Type': 'work'}}}} Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise error Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi '#$%' Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:08.523566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 15:23:08.524861 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 15:23:08.525907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 05 15:23:08.525907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.525907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fbc326f6-3a4e-4233-97e4-94f22c587100 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:08.525907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fbc326f6-3a4e-4233-97e4-94f22c587100 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.130206 Sep 05 15:23:08.525907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1969/3800] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 5 15:23:08 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 05 15:23:08.531682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cfabf392-0da0-4d21-a9b7-305980ef375d tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Action: 'create', calling method: .version_select at 0x7fb191537dc0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-896453164", "metadata": {"Type": "work"}}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cfabf392-0da0-4d21-a9b7-305980ef375d tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Request method failure captured: Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 119 Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhRcebp8Jr7QR-TjZ4w50aswuwuuIj7Egp99eCmwvcBrF3XrUNHU5YRZmMe_08DvoU2Aj_GXN6aMh60WzBwGY8YUtQXm4P_6NsQM5mbOFHB6daC1FKdc45xHbV1wN739ndGXlr_e4QZOuYjQluytTJpBNnJrRk4EPMDVAZqqeZEPvEI Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:23:08.536217 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb5447bb1f444ff1a5de329c02db774b"}]}] Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c038f043eda14202b4d5594b51027220 Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-896453164", "metadata": {"Type": "work"}}} Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 15:23:08.537608 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-896453164', 'metadata': {'Type': 'work'}}}} Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise error Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi '0' Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:08.538601 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 15:23:08.540226 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 15:23:08.541579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 05 15:23:08.541579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.541579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cfabf392-0da0-4d21-a9b7-305980ef375d tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:08.541579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cfabf392-0da0-4d21-a9b7-305980ef375d tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010083 Sep 05 15:23:08.541579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1832/3801] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 5 15:23:08 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 15:23:08.548585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-344ec64d-1355-4b19-9eb7-8d516c376ac5 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Action: 'create', calling method: .version_select at 0x7fb194d0f160>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-988456621", "metadata": {"Type": "work"}}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-344ec64d-1355-4b19-9eb7-8d516c376ac5 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Request method failure captured: Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 118 Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhRcebp8Jr7QR-TjZ4w50aswuwuuIj7Egp99eCmwvcBrF3XrUNHU5YRZmMe_08DvoU2Aj_GXN6aMh60WzBwGY8YUtQXm4P_6NsQM5mbOFHB6daC1FKdc45xHbV1wN739ndGXlr_e4QZOuYjQluytTJpBNnJrRk4EPMDVAZqqeZEPvEI Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:23:08.553316 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb5447bb1f444ff1a5de329c02db774b"}]}] Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c038f043eda14202b4d5594b51027220 Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-988456621", "metadata": {"Type": "work"}}} Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: Sep 05 15:23:08.554694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-988456621', 'metadata': {'Type': 'work'}}}} Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise error Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi '' Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:08.556214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 05 15:23:08.557635 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 05 15:23:08.558687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 05 15:23:08.558687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.558687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-344ec64d-1355-4b19-9eb7-8d516c376ac5 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:08.558687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-344ec64d-1355-4b19-9eb7-8d516c376ac5 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010590 Sep 05 15:23:08.558687 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1970/3802] 10.222.0.15 () {60 vars in 1156 bytes} [Mon Sep 5 15:23:08 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 05 15:23:08.565931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80a5017f-bfdf-4123-baeb-d1c74c607942 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Calling method '.version_select at 0x7fb194ce8280>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:23:08.579072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 58616. Sep 05 15:23:08.696770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-80a5017f-bfdf-4123-baeb-d1c74c607942 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] HTTP exception thrown: Volume tempest-invalid-1252733599 could not be found. Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80a5017f-bfdf-4123-baeb-d1c74c607942 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Request method failure captured: Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1252733599 HTTP/1.1 Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhRcebp8Jr7QR-TjZ4w50aswuwuuIj7Egp99eCmwvcBrF3XrUNHU5YRZmMe_08DvoU2Aj_GXN6aMh60WzBwGY8YUtQXm4P_6NsQM5mbOFHB6daC1FKdc45xHbV1wN739ndGXlr_e4QZOuYjQluytTJpBNnJrRk4EPMDVAZqqeZEPvEI Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:23:08.700023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb5447bb1f444ff1a5de329c02db774b"}]}] Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c038f043eda14202b4d5594b51027220 Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Volume tempest-invalid-1252733599 could not be found. Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': 'tempest-invalid-1252733599'} Sep 05 15:23:08.701471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1252733599 could not be found. (HTTP 404) (Request-ID: req-1a9bdbdd-54bb-43af-a57f-6c5342f1dca3) Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.702371 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 15:23:08.703743 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1252733599 could not be found. Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:23:08.705645 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1252733599 could not be found. Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1252733599 could not be found. Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-80a5017f-bfdf-4123-baeb-d1c74c607942 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Returning 404 to user: Volume tempest-invalid-1252733599 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-80a5017f-bfdf-4123-baeb-d1c74c607942 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1252733599" status: 404 len: 99 microversion: 2.1 time: 0.141296 Sep 05 15:23:08.707327 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1833/3803] 10.222.0.15 () {58 vars in 1218 bytes} [Mon Sep 5 15:23:08 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1252733599 => generated 99 bytes in 142 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 05 15:23:08.712545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-486a6602-0152-4f59-9c52-ecacdb81246c tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004482 Sep 05 15:23:08.713032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1971/3804] 10.222.0.15 () {58 vars in 1140 bytes} [Mon Sep 5 15:23:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 05 15:23:08.721146 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e6002da9-2b06-426c-83fe-74e64d674e42 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003670 Sep 05 15:23:08.721620 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1834/3805] 10.222.0.15 () {58 vars in 1137 bytes} [Mon Sep 5 15:23:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 05 15:23:08.730396 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0fa3e64f-ddc2-4b51-8dcb-3b33930fab61 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Calling method '.version_select at 0x7fb194bb6dc0>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:23:08.812263 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-0fa3e64f-ddc2-4b51-8dcb-3b33930fab61 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] HTTP exception thrown: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0fa3e64f-ddc2-4b51-8dcb-3b33930fab61 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Request method failure captured: Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: DELETE /compute/v2.1/os-volumes/63eb7acf-c4f9-48d4-995f-bbe1ad1051ab HTTP/1.1 Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhRcebp8Jr7QR-TjZ4w50aswuwuuIj7Egp99eCmwvcBrF3XrUNHU5YRZmMe_08DvoU2Aj_GXN6aMh60WzBwGY8YUtQXm4P_6NsQM5mbOFHB6daC1FKdc45xHbV1wN739ndGXlr_e4QZOuYjQluytTJpBNnJrRk4EPMDVAZqqeZEPvEI Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:23:08.814727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb5447bb1f444ff1a5de329c02db774b"}]}] Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: c038f043eda14202b4d5594b51027220 Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '63eb7acf-c4f9-48d4-995f-bbe1ad1051ab'} Sep 05 15:23:08.816221 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. (HTTP 404) (Request-ID: req-f0558fb0-5610-48e5-b5dd-2eb1dbd5c29f) Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.817047 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 05 15:23:08.818082 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 05 15:23:08.819106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0fa3e64f-ddc2-4b51-8dcb-3b33930fab61 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Returning 404 to user: Volume 63eb7acf-c4f9-48d4-995f-bbe1ad1051ab could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0fa3e64f-ddc2-4b51-8dcb-3b33930fab61 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "DELETE /compute/v2.1/os-volumes/63eb7acf-c4f9-48d4-995f-bbe1ad1051ab" status: 404 len: 109 microversion: 2.1 time: 0.089604 Sep 05 15:23:08.820100 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1972/3806] 10.222.0.15 () {58 vars in 1248 bytes} [Mon Sep 5 15:23:08 2022] DELETE /compute/v2.1/os-volumes/63eb7acf-c4f9-48d4-995f-bbe1ad1051ab => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 05 15:23:08.825931 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-87be6b20-0ce7-4477-8619-2b58fd0af7a7 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Calling method '.version_select at 0x7fb1915c0a60>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:23:08.853583 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-87be6b20-0ce7-4477-8619-2b58fd0af7a7 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] HTTP exception thrown: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-87be6b20-0ce7-4477-8619-2b58fd0af7a7 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Request method failure captured: Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/os-volumes/126af9cc-70a1-4f3a-aed2-edafe36ad65e HTTP/1.1 Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhRcebp8Jr7QR-TjZ4w50aswuwuuIj7Egp99eCmwvcBrF3XrUNHU5YRZmMe_08DvoU2Aj_GXN6aMh60WzBwGY8YUtQXm4P_6NsQM5mbOFHB6daC1FKdc45xHbV1wN739ndGXlr_e4QZOuYjQluytTJpBNnJrRk4EPMDVAZqqeZEPvEI Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:23:08.855516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/eb5447bb1f444ff1a5de329c02db774b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_eb5447bb1f444ff1a5de329c02db774b"}]}] Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: eb5447bb1f444ff1a5de329c02db774b Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-VolumesNegativeTest-1616158684 Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: c038f043eda14202b4d5594b51027220 Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-VolumesNegativeTest-1616158684-project Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '126af9cc-70a1-4f3a-aed2-edafe36ad65e'} Sep 05 15:23:08.856756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. (HTTP 404) (Request-ID: req-c391f42b-fb19-42b5-883f-9d34fab0a926) Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.857489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 05 15:23:08.858897 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 05 15:23:08.860199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-87be6b20-0ce7-4477-8619-2b58fd0af7a7 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] Returning 404 to user: Volume 126af9cc-70a1-4f3a-aed2-edafe36ad65e could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-87be6b20-0ce7-4477-8619-2b58fd0af7a7 tempest-VolumesNegativeTest-1616158684 tempest-VolumesNegativeTest-1616158684-project] 10.222.0.15 "GET /compute/v2.1/os-volumes/126af9cc-70a1-4f3a-aed2-edafe36ad65e" status: 404 len: 109 microversion: 2.1 time: 0.034755 Sep 05 15:23:08.862093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1835/3807] 10.222.0.15 () {58 vars in 1245 bytes} [Mon Sep 5 15:23:08 2022] GET /compute/v2.1/os-volumes/126af9cc-70a1-4f3a-aed2-edafe36ad65e => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:23:53.674991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:23:53.675833 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:23:53.849713 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-83f35e8f-c487-4402-a89e-1c865b01561a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Action: 'create', calling method: .version_select at 0x7fb1917738b0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1809918934", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGhLGTs45swinsN/gNlsuQ5Q4HOUbJIWFJM4iUyXZl8e3Zh5WarFw2NhhhTIrjas1AkyL3d6sm/5yEkTEFxVMPr2MMeODHnt+dDm85zTuYcotY4qKgMXq9rT/PXXEMCbfA=="}} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:23:53.876150 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-83f35e8f-c487-4402-a89e-1c865b01561a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for project 849d1e5bc370483790ad5d08840aee6b. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:23:53.880890 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.quota [None req-83f35e8f-c487-4402-a89e-1c865b01561a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for user 4c108d58bd84404584e02db115dd8cd5 and project 849d1e5bc370483790ad5d08840aee6b. Resources: {'key_pairs'} {{(pid=127608) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:23:53.999069 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-83f35e8f-c487-4402-a89e-1c865b01561a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.325168 Sep 05 15:23:54.000216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1973/3808] 10.222.0.15 () {60 vars in 1159 bytes} [Mon Sep 5 15:23:53 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:24:22.862922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=5 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:22.866245 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=5 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:22.868689 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1401326812", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1809918934", "security_groups": [{"name": "tempest-secgroup-smoke-1624457657"}], "block_device_mapping_v2": [{"uuid": "24131141-5286-4c09-b6fb-9d57e957a525", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a74ffff-065e-4fe0-be18-2bdeec9afe00"}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:24:22.980535 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] validate_networks() for [('7a74ffff-065e-4fe0-be18-2bdeec9afe00', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 15:24:23.497687 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 15:24:23.498105 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 15:24:23.498571 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 15:24:23.499008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 15:24:23.499416 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 15:24:23.508117 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:23.508585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:23.509008 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:23.509714 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:23.510157 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:23.510572 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:23.527711 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for project 849d1e5bc370483790ad5d08840aee6b. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:24:23.531540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for user 4c108d58bd84404584e02db115dd8cd5 and project 849d1e5bc370483790ad5d08840aee6b. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:24:23.586749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 15:24:23.588892 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24131141-5286-4c09-b6fb-9d57e957a525',volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 15:24:23.995359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f16fb2b4-85b2-4d93-b7a6-070e2b0189e7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.134127 Sep 05 15:24:23.996269 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1836/3809] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 15:24:22 2022] POST /compute/v2.1/servers => generated 406 bytes in 1136 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 15:24:24.005226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=4 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:24.007720 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:24.010114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-bfdf67b6-b40d-4220-84a9-8f11a836a918 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:24.010731 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-bfdf67b6-b40d-4220-84a9-8f11a836a918 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:24.071019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-bfdf67b6-b40d-4220-84a9-8f11a836a918 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:24.078474 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-bfdf67b6-b40d-4220-84a9-8f11a836a918 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1095 microversion: 2.1 time: 0.074588 Sep 05 15:24:24.083900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1974/3810] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:24 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1095 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:25.100881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:25.101490 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:25.108686 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:25.109169 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:25.109605 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:25.110290 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:25.110740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:25.111191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:25.176172 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:25.182254 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-dc3bf600-2c4f-4d3d-94e3-d7d67661d766 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1145 microversion: 2.1 time: 0.085341 Sep 05 15:24:25.182845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1837/3811] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:25 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:26.206633 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:26.207222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:26.214252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:26.214729 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:26.215244 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:26.215938 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:26.216384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:26.216835 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:26.277370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:26.285579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b0c354e5-9fa1-4935-b7c1-5bf470782c1a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1193 microversion: 2.1 time: 0.083524 Sep 05 15:24:26.286137 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1975/3812] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:26 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1193 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:27.314638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:27.315302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:27.321635 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:27.322113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:27.322591 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:27.323306 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:27.323756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:27.324171 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:27.474829 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:27.484015 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-3ab952e5-554b-4744-ab21-3bda25ac369e tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1279 microversion: 2.1 time: 0.173470 Sep 05 15:24:27.484581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1838/3813] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:27 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1279 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:28.105915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-2efc8810-7414-467c-91ff-25bd92613901 req-9d396f81-c31d-4b87-a922-4908f7be3c94 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3ac644-5ebd-46f9-922c-80cde82e3c41", "tag": "52906b86-b99b-45f7-a499-d27e071ef0ab"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:24:28.116035 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2efc8810-7414-467c-91ff-25bd92613901 req-9d396f81-c31d-4b87-a922-4908f7be3c94 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:28.119153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2efc8810-7414-467c-91ff-25bd92613901 req-9d396f81-c31d-4b87-a922-4908f7be3c94 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:28.119153 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-2efc8810-7414-467c-91ff-25bd92613901 req-9d396f81-c31d-4b87-a922-4908f7be3c94 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:28.130206 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-2efc8810-7414-467c-91ff-25bd92613901 req-9d396f81-c31d-4b87-a922-4908f7be3c94 service nova] Creating event network-changed:52906b86-b99b-45f7-a499-d27e071ef0ab for instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 on hv-cinder-84290 Sep 05 15:24:28.136187 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-2efc8810-7414-467c-91ff-25bd92613901 req-9d396f81-c31d-4b87-a922-4908f7be3c94 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033949 Sep 05 15:24:28.136782 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1976/3814] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:24:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 15:24:28.507705 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:28.508588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:28.515299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:28.515915 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:28.516311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:28.517074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:28.517594 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:28.518078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:28.656296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:28.664153 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bda117e8-921f-4e8e-9780-a6d8ec4a2d37 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.160593 Sep 05 15:24:28.664811 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1839/3815] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:28 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:29.689463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:29.690147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:29.696211 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:29.696686 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:29.697117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:29.697793 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:29.698240 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:29.698654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:29.825847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:29.833414 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a4841c73-fd5a-4980-a48e-9b4027a2e632 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.149119 Sep 05 15:24:29.833973 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1977/3816] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:29 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:30.856065 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:30.857194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:30.863556 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:30.864027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:30.864455 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:30.865128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:30.865573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:30.865991 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:30.995615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:31.003928 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-06716f67-0acd-4cd3-9147-758acd78f645 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.151738 Sep 05 15:24:31.004476 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1840/3817] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:30 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:32.026061 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:32.026705 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:32.033317 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:32.033754 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:32.034191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:32.034909 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:32.035369 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:32.035796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:32.164505 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:32.172663 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-603c5a0e-e392-49e3-b395-a9a7962246a4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.150531 Sep 05 15:24:32.173236 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1978/3818] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:32 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:33.196484 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:33.197089 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:33.203510 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:33.203965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:33.204393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:33.205062 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:33.205507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:33.205922 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:33.334703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:33.342739 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-39dcefba-8a8d-4cf7-af39-19bdc35a9cf2 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.150150 Sep 05 15:24:33.343317 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1841/3819] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:33 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:34.365786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:34.366413 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:34.368859 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:34.373646 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:34.374120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:34.374553 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:34.375258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:34.375706 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:34.376122 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:34.506364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:34.514433 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-205290fb-deeb-4fea-8f68-4c86cc4c051b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.152547 Sep 05 15:24:34.515272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1979/3820] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:34 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:35.537382 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:35.538022 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:35.539861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:35.540512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:24:35.546557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:35.552175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:35.552175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:35.552175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:35.552175 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:35.552540 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:35.675875 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:35.683311 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-7c6bad55-c8ed-4bef-9fe6-72c2c6cf3f3c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.149777 Sep 05 15:24:35.683872 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1842/3821] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:35 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:36.706204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:36.707193 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:36.715581 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:36.721594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:36.721594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:36.721594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:36.721594 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:36.721954 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:36.852418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:36.860685 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dba34c93-4ae8-47f4-8d06-bcf4dbf1d3f9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.159119 Sep 05 15:24:36.861258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1980/3822] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:36 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:37.884425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:37.885023 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:37.891980 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:37.892475 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:37.892914 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:37.893647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:37.894103 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:37.894529 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:38.025491 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:38.033648 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2c430369-f573-46da-83ce-d9ec2fdb00b9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.153129 Sep 05 15:24:38.034215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1843/3823] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:37 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:38.416307 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-8a55c6bd-66e1-494f-a0ea-c4dc07ca3aaf req-3ff069f4-c9a5-48b6-ace3-d7199fc8241b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3ac644-5ebd-46f9-922c-80cde82e3c41", "name": "network-vif-plugged", "status": "completed", "tag": "52906b86-b99b-45f7-a499-d27e071ef0ab"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:24:38.426910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8a55c6bd-66e1-494f-a0ea-c4dc07ca3aaf req-3ff069f4-c9a5-48b6-ace3-d7199fc8241b service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:38.426910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8a55c6bd-66e1-494f-a0ea-c4dc07ca3aaf req-3ff069f4-c9a5-48b6-ace3-d7199fc8241b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:38.426910 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-8a55c6bd-66e1-494f-a0ea-c4dc07ca3aaf req-3ff069f4-c9a5-48b6-ace3-d7199fc8241b service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:38.437427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-8a55c6bd-66e1-494f-a0ea-c4dc07ca3aaf req-3ff069f4-c9a5-48b6-ace3-d7199fc8241b service nova] Creating event network-vif-plugged:52906b86-b99b-45f7-a499-d27e071ef0ab for instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 on hv-cinder-84290 Sep 05 15:24:38.442378 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-8a55c6bd-66e1-494f-a0ea-c4dc07ca3aaf req-3ff069f4-c9a5-48b6-ace3-d7199fc8241b service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085502 Sep 05 15:24:38.442994 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1981/3824] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:24:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:24:39.056860 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:39.057471 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:39.063519 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:39.063992 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:39.064464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:39.065113 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:39.065558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:39.065972 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:39.355018 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:39.363348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-8038fbd3-efe0-4ee9-a181-ec243877bfa9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.310327 Sep 05 15:24:39.363932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1844/3825] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:39 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:40.387106 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:40.387797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:40.394590 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:40.395090 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:40.395521 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:40.396192 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:40.396639 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:40.397055 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:40.526961 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:40.535341 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6a66e091-e104-4c4a-a5b2-6ec4896630d3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1267 microversion: 2.1 time: 0.152444 Sep 05 15:24:40.536110 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1982/3826] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:40 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:41.557444 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:41.558050 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:41.564368 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:41.564848 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:41.565276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:41.565979 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:41.566430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:41.566881 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:41.693483 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:41.701133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-18d968be-ad0b-4537-98b5-bd7060b6c887 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1454 microversion: 2.1 time: 0.147612 Sep 05 15:24:41.701695 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1845/3827] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:41 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1454 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:41.723566 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:24:41.724210 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:24:41.730484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:41.731002 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:41.731457 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:41.732125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:41.732574 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:41.733558 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:41.864837 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:24:41.872463 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-38bb690e-205e-4bbe-94dc-348ebe373bbe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1454 microversion: 2.1 time: 0.152710 Sep 05 15:24:41.873032 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1983/3828] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:24:41 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1454 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:24:43.976068 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-b1633eb5-dda3-42e4-ae8e-1b2e1c6dbf26 req-0c8a2648-cd48-412f-8121-74d13bc0e65d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b3ac644-5ebd-46f9-922c-80cde82e3c41", "tag": "52906b86-b99b-45f7-a499-d27e071ef0ab"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:24:43.987440 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b1633eb5-dda3-42e4-ae8e-1b2e1c6dbf26 req-0c8a2648-cd48-412f-8121-74d13bc0e65d service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:24:43.987918 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b1633eb5-dda3-42e4-ae8e-1b2e1c6dbf26 req-0c8a2648-cd48-412f-8121-74d13bc0e65d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:24:43.988354 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-b1633eb5-dda3-42e4-ae8e-1b2e1c6dbf26 req-0c8a2648-cd48-412f-8121-74d13bc0e65d service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:24:43.999155 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-b1633eb5-dda3-42e4-ae8e-1b2e1c6dbf26 req-0c8a2648-cd48-412f-8121-74d13bc0e65d service nova] Creating event network-changed:52906b86-b99b-45f7-a499-d27e071ef0ab for instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 on hv-cinder-84290 Sep 05 15:24:44.005557 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-b1633eb5-dda3-42e4-ae8e-1b2e1c6dbf26 req-0c8a2648-cd48-412f-8121-74d13bc0e65d service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Sep 05 15:24:44.006584 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1846/3829] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:24:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:26:57.799312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:26:57.799899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 (ip 10.222.0.15) !!! Sep 05 15:26:57.800569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 05 15:26:57.800722 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:26:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 (ip 10.222.0.15) !!! Sep 05 15:26:57.801913 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=22 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:26:57.802650 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=46 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:26:57.807117 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:26:57.813732 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:26:57.815330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:26:57.815810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:26:57.816239 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:26:57.816914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:26:57.817359 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:26:57.817776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:26:57.844260 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:26:58.143849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-c6c98fd0-da06-4f31-b87a-87c7acac4b21 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 204 len: 0 microversion: 2.1 time: 0.346390 Sep 05 15:26:58.144537 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1984/3830] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:26:57 2022] DELETE /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:26:58.151845 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:26:58.152621 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=58 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:26:58.153450 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:26:58.153590 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:26:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 (ip 10.222.0.15) !!! Sep 05 15:26:58.156126 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Too many heartbeats missed Sep 05 15:26:58.164247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:26:58.164956 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:26:58.172305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:26:58.179007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:26:58.179007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:26:58.179007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:26:58.179007 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:26:58.179441 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:26:58.305606 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:26:58.313291 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-4245049d-7818-4d81-827c-e90c2f90a7f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1578 microversion: 2.1 time: 0.163877 Sep 05 15:26:58.316448 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1847/3831] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:26:58 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1578 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:26:59.337984 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:26:59.338736 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:26:59.345291 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:26:59.345725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:26:59.346147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:26:59.346853 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:26:59.347311 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:26:59.347899 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:26:59.480434 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:26:59.488282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06d5865f-afec-4514-b2e7-329fa5058654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1578 microversion: 2.1 time: 0.154587 Sep 05 15:26:59.488850 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1985/3832] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:26:59 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:00.512158 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:00.512692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:00.519770 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:00.520246 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:00.520668 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:00.521389 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:00.521835 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:00.522255 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:00.654047 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:00.661791 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-91a907c9-9171-43fc-81e3-da1680ad15aa tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1578 microversion: 2.1 time: 0.153630 Sep 05 15:27:00.662563 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1848/3833] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:00 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:01.002049 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-502cbf87-d4fd-4b1b-b2ef-e374585a6268 req-4fd21e84-11ce-4d67-8237-98607e8a69cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b3ac644-5ebd-46f9-922c-80cde82e3c41", "name": "network-vif-deleted", "tag": "52906b86-b99b-45f7-a499-d27e071ef0ab"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:27:01.012836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-502cbf87-d4fd-4b1b-b2ef-e374585a6268 req-4fd21e84-11ce-4d67-8237-98607e8a69cc service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:01.013394 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-502cbf87-d4fd-4b1b-b2ef-e374585a6268 req-4fd21e84-11ce-4d67-8237-98607e8a69cc service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:01.013834 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-502cbf87-d4fd-4b1b-b2ef-e374585a6268 req-4fd21e84-11ce-4d67-8237-98607e8a69cc service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:01.026562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-502cbf87-d4fd-4b1b-b2ef-e374585a6268 req-4fd21e84-11ce-4d67-8237-98607e8a69cc service nova] Creating event network-vif-deleted:52906b86-b99b-45f7-a499-d27e071ef0ab for instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 on hv-cinder-84290 Sep 05 15:27:01.032268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-502cbf87-d4fd-4b1b-b2ef-e374585a6268 req-4fd21e84-11ce-4d67-8237-98607e8a69cc service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142295 Sep 05 15:27:01.035838 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1986/3834] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:27:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:27:01.685638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:01.686250 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:01.693116 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:01.693603 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:01.694036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:01.694735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:01.695219 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:01.695642 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:01.727960 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:01.728459 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:01.728910 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:01.729356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lazy-loading 'fault' on Instance uuid 6b3ac644-5ebd-46f9-922c-80cde82e3c41 {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:27:01.777908 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:01.785894 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9abd0811-cf1f-4e5d-8a5e-04e7fa2dbcc3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 200 len: 1231 microversion: 2.1 time: 0.104249 Sep 05 15:27:01.793485 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1849/3835] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:01 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 1231 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:02.810509 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:02.811235 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:02.817420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:02.817932 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:02.818370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:02.819085 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:02.819569 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:02.819996 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:02.833048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] HTTP exception thrown: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Request method failure captured: Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 HTTP/1.1 Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhSDn4Rk59jDAl3SLe-Gdlef4gxwUwttNK8g9C0MUxdaw7Lb3qBKQKbjqupgBka0nxyzcP_oYlKmK4_CbwYafQtOCTFsHNJTQrJ0wPJRR9rsbdexpUCamIpefjxla1HRr3QoeZ_0YKBAvrk2ZDXHtFJss5GlBv2f5vIpmLInaA3iCBI Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:27:02.835294 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_849d1e5bc370483790ad5d08840aee6b"}]}] Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 4c108d58bd84404584e02db115dd8cd5 Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:27:02.836827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '6b3ac644-5ebd-46f9-922c-80cde82e3c41'} Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:27:02.837725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:27:02.839232 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:27:02.840548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Returning 404 to user: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:27:02.840548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e9c7216b-90b9-46c2-bf60-e72542657b3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 404 len: 111 microversion: 2.1 time: 0.030829 Sep 05 15:27:02.840548 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1987/3836] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:02 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:27:02.884199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-789111780", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1809918934", "security_groups": [{"name": "tempest-secgroup-smoke-1624457657"}], "block_device_mapping_v2": [{"uuid": "24131141-5286-4c09-b6fb-9d57e957a525", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a74ffff-065e-4fe0-be18-2bdeec9afe00"}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:27:03.001760 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] validate_networks() for [('7a74ffff-065e-4fe0-be18-2bdeec9afe00', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 15:27:03.365001 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 15:27:03.365534 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 15:27:03.366009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 15:27:03.366414 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 15:27:03.366859 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 15:27:03.375646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:03.376150 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:03.376585 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:03.377305 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:03.377756 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:03.378177 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:03.395241 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for project 849d1e5bc370483790ad5d08840aee6b. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:27:03.399763 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for user 4c108d58bd84404584e02db115dd8cd5 and project 849d1e5bc370483790ad5d08840aee6b. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:27:03.455861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 15:27:03.457935 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='24131141-5286-4c09-b6fb-9d57e957a525',volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 15:27:03.840359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-fd6b6be5-b7da-4148-afdd-ae5ec0fc0fe3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.960120 Sep 05 15:27:03.841160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1850/3837] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 15:27:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 961 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 15:27:03.852649 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-6d65900a-8184-4ca0-83a6-706fecbb9dfe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:03.853340 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-6d65900a-8184-4ca0-83a6-706fecbb9dfe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:03.910044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-6d65900a-8184-4ca0-83a6-706fecbb9dfe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:03.917265 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-6d65900a-8184-4ca0-83a6-706fecbb9dfe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1094 microversion: 2.1 time: 0.068921 Sep 05 15:27:03.917827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1988/3838] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:03 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:27:04.940430 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:04.940967 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:04.947073 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:04.948133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:04.948133 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:04.948701 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:04.949152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:04.949580 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:05.009581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:05.017230 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-95b396aa-e15b-4c08-850b-5592a40031ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1144 microversion: 2.1 time: 0.081395 Sep 05 15:27:05.018038 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1851/3839] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:04 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1144 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:06.041877 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:06.042489 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:06.050238 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:06.050724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:06.051189 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:06.051882 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:06.052374 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:06.052796 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:06.121147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:06.128694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1cdce69-d75f-4c4f-8c0c-a41b8b29a2a1 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1210 microversion: 2.1 time: 0.091852 Sep 05 15:27:06.129250 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1989/3840] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:06 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:07.153135 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:07.153719 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:07.160413 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:07.160837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:07.161271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:07.162009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:07.162458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:07.162912 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:07.301692 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:07.310128 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-1710ee02-4f98-4f00-80ac-399a6c02e464 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1278 microversion: 2.1 time: 0.160909 Sep 05 15:27:07.310681 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1852/3841] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:07 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:07.553714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-f8a663c9-96fe-45db-b2b7-ebe5dfc14340 req-e508c0f3-6e27-44b9-9d00-a59d5f862cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d393aa-3c9a-4375-85a5-17109da2c7cb", "tag": "cc578ccd-6c97-43d8-afcc-c95c0eff53a5"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:27:07.563456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f8a663c9-96fe-45db-b2b7-ebe5dfc14340 req-e508c0f3-6e27-44b9-9d00-a59d5f862cf4 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:07.564010 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f8a663c9-96fe-45db-b2b7-ebe5dfc14340 req-e508c0f3-6e27-44b9-9d00-a59d5f862cf4 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:07.564437 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f8a663c9-96fe-45db-b2b7-ebe5dfc14340 req-e508c0f3-6e27-44b9-9d00-a59d5f862cf4 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:07.575271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-f8a663c9-96fe-45db-b2b7-ebe5dfc14340 req-e508c0f3-6e27-44b9-9d00-a59d5f862cf4 service nova] Creating event network-changed:cc578ccd-6c97-43d8-afcc-c95c0eff53a5 for instance 71d393aa-3c9a-4375-85a5-17109da2c7cb on hv-cinder-84290 Sep 05 15:27:07.580027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-f8a663c9-96fe-45db-b2b7-ebe5dfc14340 req-e508c0f3-6e27-44b9-9d00-a59d5f862cf4 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030630 Sep 05 15:27:07.580620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1990/3842] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 15:27:08.334162 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:08.334697 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:08.341141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:08.341638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:08.342052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:08.342741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:08.343222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:08.343647 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:08.472093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:08.480004 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-087664c1-ddc9-470d-9b3f-b2208e176cc6 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.150395 Sep 05 15:27:08.480567 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1853/3843] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:08 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:09.503981 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:09.504679 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:09.510848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:09.511335 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:09.511768 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:09.512455 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:09.512906 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:09.513356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:09.646470 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:09.654627 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-9f0a22c4-40a0-4481-a5e2-8d319c396683 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.155476 Sep 05 15:27:09.655264 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1991/3844] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:09 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:10.677453 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:10.678651 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:10.684729 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:10.685197 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:10.685622 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:10.686293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:10.686737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:10.687206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:10.813920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:10.821706 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e9536d08-8df6-4dcd-b1ce-24246844dd85 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.148136 Sep 05 15:27:10.822258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1854/3845] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:10 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:11.843714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:11.844325 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:11.851309 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:11.851786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:11.852214 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:11.852898 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:11.853347 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:11.853781 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:11.983136 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:11.990827 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fcf75806-921d-4fdf-9533-1f179ed1e2ae tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.151176 Sep 05 15:27:11.991368 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1992/3846] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:11 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:13.013248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:13.013969 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:13.020744 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:13.021222 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:13.022292 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:13.023060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:13.023512 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:13.023940 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:13.151947 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:13.159447 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ef46e910-a975-4ec7-9454-207065e24542 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.150061 Sep 05 15:27:13.159994 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1855/3847] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:13 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:14.182261 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:14.182856 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:14.185271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=2 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:27:14.190062 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:14.190543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:14.191019 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:14.196108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:14.196108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:14.196108 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:14.322306 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:14.329907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-46ea8422-d978-4cc5-bd41-79d3e85b796a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.152065 Sep 05 15:27:14.330468 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1993/3848] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:14 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:15.357052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:15.357052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:15.357052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:27:15.357052 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=6 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:27:15.361762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:15.362248 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:15.362675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:15.364030 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:15.364646 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:15.365076 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:15.500360 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:15.508735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ab632eec-2a52-4333-bfcf-ba89c0717c8a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.160133 Sep 05 15:27:15.509316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1856/3849] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:15 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:16.532001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:16.532615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:16.539135 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:16.539614 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:16.540048 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:16.540727 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:16.541184 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:16.541602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:16.667678 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:16.675312 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-dc53368a-03d8-45da-b799-0d122f7e84c3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.147200 Sep 05 15:27:16.675876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1994/3850] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:16 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:17.164344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d393aa-3c9a-4375-85a5-17109da2c7cb", "name": "network-vif-plugged", "status": "completed", "tag": "cc578ccd-6c97-43d8-afcc-c95c0eff53a5"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:27:17.174536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:17.175082 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:17.175508 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:17.189521 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] Creating event network-vif-plugged:cc578ccd-6c97-43d8-afcc-c95c0eff53a5 for instance 71d393aa-3c9a-4375-85a5-17109da2c7cb on hv-cinder-84290 Sep 05 15:27:17.192939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] [0166ae40-1f4d-4423-ab52-514ea0ed3b36] AMQP server on 10.222.0.15:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 05 15:27:17.699129 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:17.699739 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:17.706074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:17.706561 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:17.707038 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:17.707724 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:17.708177 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:17.708598 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:17.837541 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:17.845127 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d4dc95e2-a1ff-4118-bff6-a7e14ab88a98 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.149858 Sep 05 15:27:17.845688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1995/3851] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:17 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:27:18.199303 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] [0166ae40-1f4d-4423-ab52-514ea0ed3b36] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 59416. Sep 05 15:27:18.202682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-590bb8eb-e399-4868-aec0-cb98745b775c req-8f891c3c-81ec-4759-9b37-1f03cc70f373 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 1.043096 Sep 05 15:27:18.203324 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1857/3852] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:27:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 1044 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:27:18.867983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:18.868516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:18.874991 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:18.875473 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:18.875940 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:18.876630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:18.877087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:18.877511 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:19.004308 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:19.012398 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-b86a428a-53c1-43b8-9a06-2ba7a55347ac tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.148379 Sep 05 15:27:19.012969 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1996/3853] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:18 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:27:20.037661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:20.038356 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:20.044445 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:20.044920 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:20.045348 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:20.046021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:20.046469 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:20.046977 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:20.173550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:20.181507 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-97500bd5-f2c0-4ab2-a53d-b7004ab54ebc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1266 microversion: 2.1 time: 0.149100 Sep 05 15:27:20.182074 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1858/3854] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:20 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:21.204044 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:21.204671 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:21.211149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:21.211630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:21.212064 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:21.212744 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:21.213194 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:21.213612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:21.343974 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:21.352202 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a7c71649-5d84-4abf-b95c-2e31867ffc0b tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1454 microversion: 2.1 time: 0.151959 Sep 05 15:27:21.352725 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1997/3855] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:21 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:21.374807 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:27:21.375426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:27:21.381733 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:21.382189 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:21.382618 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:21.383330 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:21.383778 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:21.384206 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:21.515425 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:27:21.521817 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-084de3e6-2b5d-4010-bc88-ddee027702a7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1454 microversion: 2.1 time: 0.150454 Sep 05 15:27:21.523339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1859/3856] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:27:21 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1454 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:27:23.664321 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-38ef0043-e939-4b56-80b9-9b62811a66b9 req-6d41158d-1b2c-47be-8eb1-4a1b141f5069 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d393aa-3c9a-4375-85a5-17109da2c7cb", "tag": "cc578ccd-6c97-43d8-afcc-c95c0eff53a5"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:27:23.673621 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-38ef0043-e939-4b56-80b9-9b62811a66b9 req-6d41158d-1b2c-47be-8eb1-4a1b141f5069 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:27:23.674114 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-38ef0043-e939-4b56-80b9-9b62811a66b9 req-6d41158d-1b2c-47be-8eb1-4a1b141f5069 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:27:23.674526 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-38ef0043-e939-4b56-80b9-9b62811a66b9 req-6d41158d-1b2c-47be-8eb1-4a1b141f5069 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:27:23.688149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-38ef0043-e939-4b56-80b9-9b62811a66b9 req-6d41158d-1b2c-47be-8eb1-4a1b141f5069 service nova] Creating event network-changed:cc578ccd-6c97-43d8-afcc-c95c0eff53a5 for instance 71d393aa-3c9a-4375-85a5-17109da2c7cb on hv-cinder-84290 Sep 05 15:27:23.693358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-38ef0043-e939-4b56-80b9-9b62811a66b9 req-6d41158d-1b2c-47be-8eb1-4a1b141f5069 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.087525 Sep 05 15:27:23.694896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1998/3857] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:27:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:29:25.062839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:29:25.067160 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-585626201", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1809918934", "security_groups": [{"name": "tempest-secgroup-smoke-1624457657"}], "block_device_mapping_v2": [{"uuid": "013eb2f6-7a5b-427e-8361-fe4db5e628c4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "7a74ffff-065e-4fe0-be18-2bdeec9afe00"}]}} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:29:25.077461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:25.078569 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=72 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:25.250138 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.network.neutron [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] validate_networks() for [('7a74ffff-065e-4fe0-be18-2bdeec9afe00', None, None, None, None, None)] {{(pid=127609) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 05 15:29:25.663320 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Flavor limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 05 15:29:25.663740 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Image limits 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 05 15:29:25.664205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Flavor pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 05 15:29:25.664638 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Image pref 0:0:0 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 05 15:29:25.665071 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.virt.hardware [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127609) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 05 15:29:25.674191 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:25.674661 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:25.675120 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:25.675826 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:25.676278 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:25.676693 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:25.693395 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for project 849d1e5bc370483790ad5d08840aee6b. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 05 15:29:25.697340 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.quota [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Getting quotas for user 4c108d58bd84404584e02db115dd8cd5 and project 849d1e5bc370483790ad5d08840aee6b. Resources: {'cores', 'instances', 'ram'} {{(pid=127609) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 05 15:29:25.753552 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Going to run 1 instances... {{(pid=127609) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 05 15:29:25.755683 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='013eb2f6-7a5b-427e-8361-fe4db5e628c4',volume_size=None,volume_type=None)] {{(pid=127609) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 05 15:29:26.084034 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 59522. Sep 05 15:29:26.178131 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-f0e96a91-5be2-416b-9596-6310e880b3da tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.117103 Sep 05 15:29:26.178768 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1860/3858] 10.222.0.15 () {60 vars in 1147 bytes} [Mon Sep 5 15:29:25 2022] POST /compute/v2.1/servers => generated 406 bytes in 1118 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 05 15:29:26.191432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ce3f5603-ab59-45d5-9bea-acb78173f427 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:26.192162 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ce3f5603-ab59-45d5-9bea-acb78173f427 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:26.194765 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] AMQP server on 10.222.0.15:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 05 15:29:26.195334 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:26.196033 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:26.298823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-ce3f5603-ab59-45d5-9bea-acb78173f427 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:26.305604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ce3f5603-ab59-45d5-9bea-acb78173f427 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1094 microversion: 2.1 time: 0.119332 Sep 05 15:29:26.306164 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 1999/3859] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:26 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1094 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:27.328504 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-067a0fb5-933d-42a7-a4a3-28020989f011 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:27.329112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-067a0fb5-933d-42a7-a4a3-28020989f011 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:27.381522 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-067a0fb5-933d-42a7-a4a3-28020989f011 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:27.388494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-067a0fb5-933d-42a7-a4a3-28020989f011 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1094 microversion: 2.1 time: 0.064353 Sep 05 15:29:27.389044 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1861/3860] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:27 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:28.411636 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-fc53a150-10d5-4aac-a6a0-97ba144789ff tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:28.412251 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-fc53a150-10d5-4aac-a6a0-97ba144789ff tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:28.424524 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] [57c91ea5-4bca-4dac-814c-cea831f56168] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 59544. Sep 05 15:29:28.471512 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-fc53a150-10d5-4aac-a6a0-97ba144789ff tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:28.479411 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-fc53a150-10d5-4aac-a6a0-97ba144789ff tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1094 microversion: 2.1 time: 0.071989 Sep 05 15:29:28.479972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2000/3861] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:28 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1094 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:29.502124 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:29.502738 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:29.510083 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:29.510615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:29.511054 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:29.517039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:29.517039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:29.517039 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:29.575107 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:29.582723 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-10db3dc6-ffb3-4bf9-9689-43126f4c6e5c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1144 microversion: 2.1 time: 0.085121 Sep 05 15:29:29.583362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1862/3862] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:29 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:29:30.604917 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:30.605531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:30.612848 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:30.617630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:30.617630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:30.617630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:30.617630 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:30.618028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:30.675668 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:30.683364 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-0484f5d1-b4ed-469d-b1a0-07e6c5567c3f tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1136 microversion: 2.1 time: 0.082361 Sep 05 15:29:30.685883 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2001/3863] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:30 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1136 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:31.705726 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:31.706359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:31.712815 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:31.714524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:31.714524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:31.714524 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:31.714981 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:31.715271 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:31.777402 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:31.785078 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-47647a57-9ac3-4a13-9973-76829e1b0ffc tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1210 microversion: 2.1 time: 0.083416 Sep 05 15:29:31.785634 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1863/3864] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:31 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:32.810560 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:32.811797 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:32.819651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:32.820226 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:32.820665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:32.821366 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:32.821828 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:32.822284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:32.957513 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:32.965216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-8c043316-b73d-4300-af1a-ecfe50aaacb9 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.159677 Sep 05 15:29:32.965775 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2002/3865] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:32 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:32.992489 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-a49a8e0b-d569-4187-92a7-c56d6dfdfd4e req-2c15d13f-7c3a-4bea-99cc-2ce658844398 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03890659-f62a-4c09-80c6-256641950dc4", "tag": "ec0d8315-cdee-4a21-9e00-f89d92ecb4a8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:29:33.003215 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-a49a8e0b-d569-4187-92a7-c56d6dfdfd4e req-2c15d13f-7c3a-4bea-99cc-2ce658844398 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:33.003774 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-a49a8e0b-d569-4187-92a7-c56d6dfdfd4e req-2c15d13f-7c3a-4bea-99cc-2ce658844398 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:33.004296 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-a49a8e0b-d569-4187-92a7-c56d6dfdfd4e req-2c15d13f-7c3a-4bea-99cc-2ce658844398 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:33.015396 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-a49a8e0b-d569-4187-92a7-c56d6dfdfd4e req-2c15d13f-7c3a-4bea-99cc-2ce658844398 service nova] Creating event network-changed:ec0d8315-cdee-4a21-9e00-f89d92ecb4a8 for instance 03890659-f62a-4c09-80c6-256641950dc4 on hv-cinder-84290 Sep 05 15:29:33.021102 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-a49a8e0b-d569-4187-92a7-c56d6dfdfd4e req-2c15d13f-7c3a-4bea-99cc-2ce658844398 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032492 Sep 05 15:29:33.021682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1864/3866] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:29:33.987593 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:33.988241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:33.994654 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:33.995168 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:33.995604 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:33.996284 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:33.996737 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:33.997155 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:34.125391 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:34.132983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d8f887fb-322d-4679-b454-0a61ed989e24 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.149264 Sep 05 15:29:34.133579 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2003/3867] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:33 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:35.157518 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:35.158273 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:35.164362 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:35.164843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:35.165304 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:35.165988 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:35.166464 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:35.166925 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:35.298243 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:35.305841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-92989570-e7b4-4df4-b336-ca80c7fbfefd tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.153498 Sep 05 15:29:35.306397 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1865/3868] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:35 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:36.329384 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:36.329914 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:36.336358 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:36.336836 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:36.337272 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:36.337949 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:36.338402 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:36.338847 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:36.476767 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:36.484497 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-7f4e745e-4965-47c1-9010-2c4b91228655 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.159602 Sep 05 15:29:36.485068 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2004/3869] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:36 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:37.507345 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:37.507954 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:37.509934 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=2 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:37.511125 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell0:SELECT=8 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:37.515779 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:37.516257 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:37.516694 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:37.517374 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:37.517825 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:37.518247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:37.646461 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:37.654088 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-2673e0e8-da7e-4aa5-b06a-ec49fcefe51a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.150623 Sep 05 15:29:37.654650 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1866/3870] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:37 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:38.678006 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:38.678580 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:38.680865 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell0:SELECT=4 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:29:38.685539 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:38.686016 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:38.686446 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:38.687147 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:38.687592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:38.688009 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:38.820252 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:38.828258 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-1329aacc-1b1d-41b8-9d05-413f575b68fe tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.153998 Sep 05 15:29:38.828831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2005/3871] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:38 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 05 15:29:39.850924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:39.851536 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:39.857886 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:39.858370 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:39.858837 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:39.859531 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:39.860506 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:39.860932 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:39.989147 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:39.996780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-17b93fa6-c639-481a-8313-fa23e728bb12 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.149856 Sep 05 15:29:39.997339 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1867/3872] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:39 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:41.021204 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:41.021815 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:41.028178 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:41.028660 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:41.029091 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:41.029773 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:41.030229 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:41.030651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:41.159960 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:41.167854 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-83ebacb5-c157-48aa-9fd8-23d65fded7a3 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.151366 Sep 05 15:29:41.168420 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2006/3873] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:41 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:42.191433 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:42.192036 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:42.198341 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:42.198843 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:42.199284 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:42.199959 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:42.200405 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:42.200822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:42.331827 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:42.339516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-e5997916-d9fa-451a-bd15-4e4509a98e23 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.152606 Sep 05 15:29:42.340072 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1868/3874] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:42 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:43.361464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:43.362001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:43.368410 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:43.368892 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:43.369327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:43.370013 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:43.370466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:43.370916 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:43.498492 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:43.506752 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-d54ee4fb-af70-4744-a2e3-30d27cfaa5ca tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.149277 Sep 05 15:29:43.507344 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2007/3875] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:43 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:44.530494 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:44.531139 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:44.538077 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:44.538550 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:44.539027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:44.539708 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:44.540159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:44.540581 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:44.669497 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:44.677053 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-94421355-d266-4802-9f61-fb3130518b67 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.150482 Sep 05 15:29:44.677612 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1869/3876] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:44 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:45.699915 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:45.700522 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:45.706929 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:45.707418 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:45.707855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:45.708545 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:45.709001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:45.709453 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:45.843283 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:45.851831 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a9807370-dcce-4ba0-b57c-fee9de1f5ab7 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.155913 Sep 05 15:29:45.852466 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2008/3877] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:45 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:45.857375 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-6b8aa94c-8520-4206-a522-3ba5b7b8f1fc req-42fd3cba-e3f8-4fce-8d8d-9bfb0ec9da6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03890659-f62a-4c09-80c6-256641950dc4", "name": "network-vif-plugged", "status": "completed", "tag": "ec0d8315-cdee-4a21-9e00-f89d92ecb4a8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:29:45.866965 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-6b8aa94c-8520-4206-a522-3ba5b7b8f1fc req-42fd3cba-e3f8-4fce-8d8d-9bfb0ec9da6a service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:45.869302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-6b8aa94c-8520-4206-a522-3ba5b7b8f1fc req-42fd3cba-e3f8-4fce-8d8d-9bfb0ec9da6a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:45.869302 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-6b8aa94c-8520-4206-a522-3ba5b7b8f1fc req-42fd3cba-e3f8-4fce-8d8d-9bfb0ec9da6a service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:45.878562 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-6b8aa94c-8520-4206-a522-3ba5b7b8f1fc req-42fd3cba-e3f8-4fce-8d8d-9bfb0ec9da6a service nova] Creating event network-vif-plugged:ec0d8315-cdee-4a21-9e00-f89d92ecb4a8 for instance 03890659-f62a-4c09-80c6-256641950dc4 on hv-cinder-84290 Sep 05 15:29:45.883680 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-6b8aa94c-8520-4206-a522-3ba5b7b8f1fc req-42fd3cba-e3f8-4fce-8d8d-9bfb0ec9da6a service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087473 Sep 05 15:29:45.884262 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1870/3878] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:29:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:29:46.874585 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:46.875219 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:46.881612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:46.882086 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:46.882516 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:46.883222 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:46.883670 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:46.884087 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:47.014721 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:47.023246 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-98448450-ae30-4066-a380-e56434ca0214 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1266 microversion: 2.1 time: 0.152460 Sep 05 15:29:47.023803 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2009/3879] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:46 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:48.047194 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:48.048479 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:48.054691 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:48.055198 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:48.055628 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:48.056299 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:48.056749 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:48.057167 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:48.185516 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:48.193205 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-523e33c4-78a2-4022-a005-8d2e740639f4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1453 microversion: 2.1 time: 0.150846 Sep 05 15:29:48.193781 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1871/3880] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:48 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:48.216810 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:29:48.217419 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:29:48.224972 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:48.225451 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:48.225879 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:48.226562 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:48.227037 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:48.227456 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:48.356993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:29:48.365427 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-3e6b1586-b258-4899-b2d0-5d2a8cf4728d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1453 microversion: 2.1 time: 0.152516 Sep 05 15:29:48.365983 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2010/3881] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:29:48 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:29:50.549804 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-569387f3-76b6-4525-b925-64e8c41d40ee req-6dfed343-40fa-496c-b725-00a1eef04783 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03890659-f62a-4c09-80c6-256641950dc4", "tag": "ec0d8315-cdee-4a21-9e00-f89d92ecb4a8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:29:50.559644 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-569387f3-76b6-4525-b925-64e8c41d40ee req-6dfed343-40fa-496c-b725-00a1eef04783 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:29:50.560114 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-569387f3-76b6-4525-b925-64e8c41d40ee req-6dfed343-40fa-496c-b725-00a1eef04783 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:29:50.560538 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-569387f3-76b6-4525-b925-64e8c41d40ee req-6dfed343-40fa-496c-b725-00a1eef04783 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:29:50.573426 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-569387f3-76b6-4525-b925-64e8c41d40ee req-6dfed343-40fa-496c-b725-00a1eef04783 service nova] Creating event network-changed:ec0d8315-cdee-4a21-9e00-f89d92ecb4a8 for instance 03890659-f62a-4c09-80c6-256641950dc4 on hv-cinder-84290 Sep 05 15:29:50.579021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-569387f3-76b6-4525-b925-64e8c41d40ee req-6dfed343-40fa-496c-b725-00a1eef04783 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032386 Sep 05 15:29:50.579610 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1872/3882] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:29:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:31:40.492543 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_api:SELECT=28 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:31:40.493328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG dbcounter [-] [127608] Writing DB stats nova_cell1:SELECT=60 {{(pid=127608) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:31:40.494120 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:31:40.498247 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] AMQP server on 10.222.0.15:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Sep 05 15:31:40.500090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:31:40.500090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG dbcounter [-] [127609] Writing DB stats nova_cell1:SELECT=56 {{(pid=127609) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 05 15:31:40.500885 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:31:40.501027 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Mon Sep 5 15:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.15) !!! Sep 05 15:31:40.502078 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 (ip 10.222.0.15) !!! Sep 05 15:31:40.503151 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:31:40.503295 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 (ip 10.222.0.15) !!! Sep 05 15:31:40.504149 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 05 15:31:40.504271 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Mon Sep 5 15:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 (ip 10.222.0.15) !!! Sep 05 15:31:40.510460 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-1e730951-f7cd-4805-8118-29203b151723 req-409d67c9-4f34-4b01-b3b9-2adc497053a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03890659-f62a-4c09-80c6-256641950dc4", "tag": "ec0d8315-cdee-4a21-9e00-f89d92ecb4a8"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:31:40.519659 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:40.520324 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:40.530576 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:40.537152 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-1e730951-f7cd-4805-8118-29203b151723 req-409d67c9-4f34-4b01-b3b9-2adc497053a6 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:40.537656 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-1e730951-f7cd-4805-8118-29203b151723 req-409d67c9-4f34-4b01-b3b9-2adc497053a6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:40.538087 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-1e730951-f7cd-4805-8118-29203b151723 req-409d67c9-4f34-4b01-b3b9-2adc497053a6 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:40.542088 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:40.542620 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:40.543385 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:40.543855 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:40.544281 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:40.550009 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-1e730951-f7cd-4805-8118-29203b151723 req-409d67c9-4f34-4b01-b3b9-2adc497053a6 service nova] Creating event network-changed:ec0d8315-cdee-4a21-9e00-f89d92ecb4a8 for instance 03890659-f62a-4c09-80c6-256641950dc4 on hv-cinder-84290 Sep 05 15:31:40.555336 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-1e730951-f7cd-4805-8118-29203b151723 req-409d67c9-4f34-4b01-b3b9-2adc497053a6 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059361 Sep 05 15:31:40.556159 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1873/3883] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:31:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:31:40.571484 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:31:40.884735 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-5ed08307-7cb4-4f75-8fed-d49f4759518d tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 204 len: 0 microversion: 2.1 time: 0.394180 Sep 05 15:31:40.885479 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2011/3884] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:31:40 2022] DELETE /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:31:40.905438 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:40.906864 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:40.913996 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:40.914741 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:40.915204 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:40.915901 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:40.916359 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:40.916785 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:41.076344 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:41.084458 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-ada3dd79-7ca0-494c-b7e4-8366fd6b34ee tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1577 microversion: 2.1 time: 0.185240 Sep 05 15:31:41.085660 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1874/3885] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:40 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:42.110993 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:42.111708 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:42.118118 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:42.118602 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:42.119083 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:42.119776 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:42.120237 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:42.121146 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:42.258079 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:42.266893 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-46a6afb1-f05c-46f0-9f6c-b0b3f31d23cf tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1577 microversion: 2.1 time: 0.160930 Sep 05 15:31:42.267465 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2012/3886] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:42 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:43.291040 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-f4f3c973-9f0f-455c-a9f2-b48b5c3305ea req-3601a3d6-99cc-4a28-97b8-b13a392467ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03890659-f62a-4c09-80c6-256641950dc4", "name": "network-vif-deleted", "tag": "ec0d8315-cdee-4a21-9e00-f89d92ecb4a8"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:31:43.296209 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:43.297093 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:43.300823 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f4f3c973-9f0f-455c-a9f2-b48b5c3305ea req-3601a3d6-99cc-4a28-97b8-b13a392467ee service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:43.301353 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f4f3c973-9f0f-455c-a9f2-b48b5c3305ea req-3601a3d6-99cc-4a28-97b8-b13a392467ee service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:43.303075 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-f4f3c973-9f0f-455c-a9f2-b48b5c3305ea req-3601a3d6-99cc-4a28-97b8-b13a392467ee service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:43.306112 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:43.306588 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:43.307090 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:43.307780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:43.308762 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:43.309184 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:43.317258 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO oslo.messaging._drivers.impl_rabbit [-] [128912ec-2710-43c8-8bb9-7705b3eb893f] Reconnected to AMQP server on 10.222.0.15:5672 via [amqp] client with port 59670. Sep 05 15:31:43.318191 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-f4f3c973-9f0f-455c-a9f2-b48b5c3305ea req-3601a3d6-99cc-4a28-97b8-b13a392467ee service nova] Creating event network-vif-deleted:ec0d8315-cdee-4a21-9e00-f89d92ecb4a8 for instance 03890659-f62a-4c09-80c6-256641950dc4 on hv-cinder-84290 Sep 05 15:31:43.323130 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-f4f3c973-9f0f-455c-a9f2-b48b5c3305ea req-3601a3d6-99cc-4a28-97b8-b13a392467ee service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035605 Sep 05 15:31:43.324282 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2013/3887] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:31:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:31:43.376328 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:43.384025 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-83c0939a-8fec-4c7a-86e2-62d1b3db37eb tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1391 microversion: 2.1 time: 0.098152 Sep 05 15:31:43.384703 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1875/3888] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:43 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1391 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:44.409050 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:44.409756 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:44.415876 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:44.416362 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:44.416799 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:44.417483 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:44.417936 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:44.418393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:44.449665 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:44.450139 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:44.450565 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:44.451028 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.objects.instance [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lazy-loading 'fault' on Instance uuid 03890659-f62a-4c09-80c6-256641950dc4 {{(pid=127608) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:31:44.495125 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:44.502697 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-896b9697-b0d9-45ca-a754-42fd912ab699 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 200 len: 1230 microversion: 2.1 time: 0.098339 Sep 05 15:31:44.505589 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2014/3889] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:44 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:45.525772 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:45.526406 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 03890659-f62a-4c09-80c6-256641950dc4] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:45.533666 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:45.534143 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:45.534573 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:45.535285 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:45.535737 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:45.536188 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:45.549946 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] HTTP exception thrown: Instance 03890659-f62a-4c09-80c6-256641950dc4 could not be found. Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Request method failure captured: Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 HTTP/1.1 Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhSDn4Rk59jDAl3SLe-Gdlef4gxwUwttNK8g9C0MUxdaw7Lb3qBKQKbjqupgBka0nxyzcP_oYlKmK4_CbwYafQtOCTFsHNJTQrJ0wPJRR9rsbdexpUCamIpefjxla1HRr3QoeZ_0YKBAvrk2ZDXHtFJss5GlBv2f5vIpmLInaA3iCBI Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:31:45.551615 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_849d1e5bc370483790ad5d08840aee6b"}]}] Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 4c108d58bd84404584e02db115dd8cd5 Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 03890659-f62a-4c09-80c6-256641950dc4 could not be found. Sep 05 15:31:45.553151 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '03890659-f62a-4c09-80c6-256641950dc4'} Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03890659-f62a-4c09-80c6-256641950dc4 could not be found. Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:31:45.554032 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03890659-f62a-4c09-80c6-256641950dc4 could not be found. Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03890659-f62a-4c09-80c6-256641950dc4 could not be found. Sep 05 15:31:45.555579 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:45.557141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Returning 404 to user: Instance 03890659-f62a-4c09-80c6-256641950dc4 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:31:45.557141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-9764ac3b-49ec-4fbd-9de5-33d7b4c17a30 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4" status: 404 len: 111 microversion: 2.1 time: 0.031370 Sep 05 15:31:45.557141 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1876/3890] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:45 2022] GET /compute/v2.1/servers/03890659-f62a-4c09-80c6-256641950dc4 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:31:48.896615 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:48.897476 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:48.898675 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [req-f33043eb-2fc2-42d0-b241-0441887a7b96 req-b8fcb987-8082-4676-ae69-461116ee6da0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71d393aa-3c9a-4375-85a5-17109da2c7cb", "tag": "cc578ccd-6c97-43d8-afcc-c95c0eff53a5"}]} {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:31:48.904371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:48.904785 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:48.905216 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:48.905902 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:48.906380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:48.906819 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:48.908119 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f33043eb-2fc2-42d0-b241-0441887a7b96 req-b8fcb987-8082-4676-ae69-461116ee6da0 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:48.908587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f33043eb-2fc2-42d0-b241-0441887a7b96 req-b8fcb987-8082-4676-ae69-461116ee6da0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:48.909199 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [req-f33043eb-2fc2-42d0-b241-0441887a7b96 req-b8fcb987-8082-4676-ae69-461116ee6da0 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:48.920861 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.compute.server_external_events [req-f33043eb-2fc2-42d0-b241-0441887a7b96 req-b8fcb987-8082-4676-ae69-461116ee6da0 service nova] Creating event network-changed:cc578ccd-6c97-43d8-afcc-c95c0eff53a5 for instance 71d393aa-3c9a-4375-85a5-17109da2c7cb on hv-cinder-84290 Sep 05 15:31:48.929587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [req-f33043eb-2fc2-42d0-b241-0441887a7b96 req-b8fcb987-8082-4676-ae69-461116ee6da0 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031095 Sep 05 15:31:48.929587 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1877/3891] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:31:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 05 15:31:48.935900 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Going to try to terminate instance {{(pid=127608) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 05 15:31:49.187688 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-a71f33bf-3335-4163-96e6-2c3a7a4f72d4 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 204 len: 0 microversion: 2.1 time: 0.294862 Sep 05 15:31:49.188786 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2015/3892] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:31:48 2022] DELETE /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 05 15:31:49.197398 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:49.198094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:49.204264 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:49.204978 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:49.205463 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:49.206316 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:49.207092 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:49.207665 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:49.341029 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:49.348823 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-bb647f76-ee79-452e-a546-e18a4edce9be tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1579 microversion: 2.1 time: 0.155588 Sep 05 15:31:49.349392 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1878/3893] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:49 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1579 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:50.373714 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:50.378531 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:50.380896 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:50.381380 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:50.381821 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:50.382515 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:50.383001 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:50.383432 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:50.516005 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.policy [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127608) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:50.522764 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-06082fb5-55eb-4ea5-91d6-3a70c2bd6654 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1579 microversion: 2.1 time: 0.153870 Sep 05 15:31:50.523356 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2016/3894] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:50 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1579 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:51.545780 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:51.546279 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:51.557982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:51.557982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:51.557982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:51.557982 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:51.559735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:51.559735 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:51.612907 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [req-596bc1b1-505f-43bc-a599-77dbc557b060 req-f68ec85b-9653-4956-946a-dd6af0110cc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71d393aa-3c9a-4375-85a5-17109da2c7cb", "name": "network-vif-deleted", "tag": "cc578ccd-6c97-43d8-afcc-c95c0eff53a5"}]} {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 05 15:31:51.623849 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-596bc1b1-505f-43bc-a599-77dbc557b060 req-f68ec85b-9653-4956-946a-dd6af0110cc8 service nova] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:51.624330 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-596bc1b1-505f-43bc-a599-77dbc557b060 req-f68ec85b-9653-4956-946a-dd6af0110cc8 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:51.624760 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [req-596bc1b1-505f-43bc-a599-77dbc557b060 req-f68ec85b-9653-4956-946a-dd6af0110cc8 service nova] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:51.629267 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:51.636027 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.compute.server_external_events [req-596bc1b1-505f-43bc-a599-77dbc557b060 req-f68ec85b-9653-4956-946a-dd6af0110cc8 service nova] Creating event network-vif-deleted:cc578ccd-6c97-43d8-afcc-c95c0eff53a5 for instance 71d393aa-3c9a-4375-85a5-17109da2c7cb on hv-cinder-84290 Sep 05 15:31:51.637822 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-cc19e85c-c237-4c39-a36e-9c086240a35c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1392 microversion: 2.1 time: 0.096115 Sep 05 15:31:51.638431 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1879/3895] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:51 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1392 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:51.641897 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [req-596bc1b1-505f-43bc-a599-77dbc557b060 req-f68ec85b-9653-4956-946a-dd6af0110cc8 service nova] 10.222.0.15 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033282 Sep 05 15:31:51.642640 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2017/3896] 10.222.0.15 () {64 vars in 1317 bytes} [Mon Sep 5 15:31:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 05 15:31:52.661134 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:52.661800 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:52.668293 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:52.669549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:52.669549 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:52.669939 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:52.670393 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:52.670841 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:52.703363 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:52.703839 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:52.704276 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:52.704717 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.objects.instance [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lazy-loading 'fault' on Instance uuid 71d393aa-3c9a-4375-85a5-17109da2c7cb {{(pid=127609) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 05 15:31:52.745712 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.policy [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4c108d58bd84404584e02db115dd8cd5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '849d1e5bc370483790ad5d08840aee6b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127609) authorize /opt/stack/nova/nova/policy.py:199}} Sep 05 15:31:52.754060 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-77f280d4-ea39-4cab-b6ca-8e4fb32c8125 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 200 len: 1230 microversion: 2.1 time: 0.096787 Sep 05 15:31:52.754629 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1880/3897] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:52 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 05 15:31:53.780592 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:53.781464 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 71d393aa-3c9a-4375-85a5-17109da2c7cb] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:53.787771 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:53.788259 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:53.788694 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:53.789393 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:53.789846 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:53.790268 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:53.804074 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] HTTP exception thrown: Instance 71d393aa-3c9a-4375-85a5-17109da2c7cb could not be found. Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Request method failure captured: Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb HTTP/1.1 Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhSDn4Rk59jDAl3SLe-Gdlef4gxwUwttNK8g9C0MUxdaw7Lb3qBKQKbjqupgBka0nxyzcP_oYlKmK4_CbwYafQtOCTFsHNJTQrJ0wPJRR9rsbdexpUCamIpefjxla1HRr3QoeZ_0YKBAvrk2ZDXHtFJss5GlBv2f5vIpmLInaA3iCBI Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:31:53.805763 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_849d1e5bc370483790ad5d08840aee6b"}]}] Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 4c108d58bd84404584e02db115dd8cd5 Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 71d393aa-3c9a-4375-85a5-17109da2c7cb could not be found. Sep 05 15:31:53.807328 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '71d393aa-3c9a-4375-85a5-17109da2c7cb'} Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71d393aa-3c9a-4375-85a5-17109da2c7cb could not be found. Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:31:53.808124 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71d393aa-3c9a-4375-85a5-17109da2c7cb could not be found. Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71d393aa-3c9a-4375-85a5-17109da2c7cb could not be found. Sep 05 15:31:53.809303 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:53.810371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Returning 404 to user: Instance 71d393aa-3c9a-4375-85a5-17109da2c7cb could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:31:53.810371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-ec1c00b9-25c2-4534-8b77-351eb0d5633a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb" status: 404 len: 111 microversion: 2.1 time: 0.031999 Sep 05 15:31:53.810371 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2018/3898] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:53 2022] GET /compute/v2.1/servers/71d393aa-3c9a-4375-85a5-17109da2c7cb => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:31:54.341094 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:54.341682 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.compute.api [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127609) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:54.348929 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:54.350924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:54.350924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:54.350924 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:54.351208 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:54.351566 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG oslo_concurrency.lockutils [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127609) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:54.364899 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.wsgi [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] HTTP exception thrown: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Request method failure captured: Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: request: DELETE /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 HTTP/1.1 Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept: application/json Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Accept-Encoding: identity Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Connection: close Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Length: 0 Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Content-Type: application/json Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Host: 10.222.0.15 Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: Openstack-System-Scope: None Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: User-Agent: python-urllib3/1.26.12 Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Auth-Token: gAAAAABjFhSDn4Rk59jDAl3SLe-Gdlef4gxwUwttNK8g9C0MUxdaw7Lb3qBKQKbjqupgBka0nxyzcP_oYlKmK4_CbwYafQtOCTFsHNJTQrJ0wPJRR9rsbdexpUCamIpefjxla1HRr3QoeZ_0YKBAvrk2ZDXHtFJss5GlBv2f5vIpmLInaA3iCBI Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Id: None Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Domain-Name: None Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Identity-Status: Confirmed Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Is-Admin-Project: True Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Id: default Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Domain-Name: Default Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Project-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Role: member,reader Sep 05 15:31:54.366558 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Roles: member,reader Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_849d1e5bc370483790ad5d08840aee6b"}]}] Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-Tenant-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Id: default Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Domain-Name: Default Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Id: 4c108d58bd84404584e02db115dd8cd5 Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: X-User-Name: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: method: > Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: exception: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.367966 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: action_args: {'id': '6b3ac644-5ebd-46f9-922c-80cde82e3c41'} Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:31:54.368679 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.369806 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.371021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Returning 404 to user: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. {{(pid=127609) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:31:54.371021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-b1b5d1b3-1143-4e4f-a150-fe8f17b8f79c tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "DELETE /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 404 len: 111 microversion: 2.1 time: 0.033498 Sep 05 15:31:54.371021 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1881/3899] 10.222.0.15 () {58 vars in 1239 bytes} [Mon Sep 5 15:31:54 2022] DELETE /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:31:54.378651 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '>' {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:54.379299 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.compute.api [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] [instance: 6b3ac644-5ebd-46f9-922c-80cde82e3c41] Fetching instance by UUID {{(pid=127608) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 05 15:31:54.385612 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:54.386109 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:54.387066 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:54.396628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Acquiring lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Sep 05 15:31:54.396628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Sep 05 15:31:54.396628 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG oslo_concurrency.lockutils [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Lock "8e0c2985-b818-4cf9-b8fa-977a4355658f" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127608) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 05 15:31:54.403327 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.wsgi [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] HTTP exception thrown: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Request method failure captured: Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: request: GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 HTTP/1.1 Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept: application/json Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Accept-Encoding: identity Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Connection: close Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Length: 0 Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Content-Type: application/json Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Host: 10.222.0.15 Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: Openstack-System-Scope: None Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: User-Agent: python-urllib3/1.26.12 Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Auth-Token: gAAAAABjFhSDn4Rk59jDAl3SLe-Gdlef4gxwUwttNK8g9C0MUxdaw7Lb3qBKQKbjqupgBka0nxyzcP_oYlKmK4_CbwYafQtOCTFsHNJTQrJ0wPJRR9rsbdexpUCamIpefjxla1HRr3QoeZ_0YKBAvrk2ZDXHtFJss5GlBv2f5vIpmLInaA3iCBI Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Id: None Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Domain-Name: None Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Identity-Status: Confirmed Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Is-Admin-Project: True Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Id: default Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Domain-Name: Default Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Project-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Role: member,reader Sep 05 15:31:54.404875 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Roles: member,reader Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15/volume/v3/849d1e5bc370483790ad5d08840aee6b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.15:9696/networking"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.15:8080", "publicURL": "http://10.222.0.15:8080/v1/AUTH_849d1e5bc370483790ad5d08840aee6b"}]}] Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Id: 849d1e5bc370483790ad5d08840aee6b Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-Tenant-Name: tempest-TestVolumeBootPattern-1692096877 Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Id: default Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Domain-Name: Default Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Id: 4c108d58bd84404584e02db115dd8cd5 Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: X-User-Name: tempest-TestVolumeBootPattern-1692096877-project Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: method: > Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: exception: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.406370 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: action_args: {'id': '6b3ac644-5ebd-46f9-922c-80cde82e3c41'} Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: {{(pid=127608) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 05 15:31:54.408070 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. Sep 05 15:31:54.409241 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: ERROR nova.api.openstack.wsgi Sep 05 15:31:54.410288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: DEBUG nova.api.openstack.wsgi [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Returning 404 to user: Instance 6b3ac644-5ebd-46f9-922c-80cde82e3c41 could not be found. {{(pid=127608) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 05 15:31:54.410288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: INFO nova.api.openstack.requestlog [None req-e1f78f2c-3f2d-488e-912e-2c48fa2a172a tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41" status: 404 len: 111 microversion: 2.1 time: 0.031446 Sep 05 15:31:54.410288 dv-cinder-842905-3-iscsi devstack@n-api.service[127608]: [pid: 127608|app: 0|req: 2019/3900] 10.222.0.15 () {58 vars in 1236 bytes} [Mon Sep 5 15:31:54 2022] GET /compute/v2.1/servers/6b3ac644-5ebd-46f9-922c-80cde82e3c41 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 05 15:31:55.871110 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: DEBUG nova.api.openstack.wsgi [None req-65095c9c-23c4-4bd8-b0bd-de97d057c828 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] Calling method '.version_select at 0x7fb1913a5040>' {{(pid=127609) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 05 15:31:55.964911 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: INFO nova.api.openstack.requestlog [None req-65095c9c-23c4-4bd8-b0bd-de97d057c828 tempest-TestVolumeBootPattern-1692096877 tempest-TestVolumeBootPattern-1692096877-project] 10.222.0.15 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1809918934" status: 202 len: 0 microversion: 2.1 time: 0.097692 Sep 05 15:31:55.965513 dv-cinder-842905-3-iscsi devstack@n-api.service[127609]: [pid: 127609|app: 0|req: 1882/3901] 10.222.0.15 () {58 vars in 1263 bytes} [Mon Sep 5 15:31:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1809918934 => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0)